mirror of
https://gitea.com/mcereda/oam.git
synced 2026-02-09 05:44:23 +00:00
chore(turbot-pipes): continue learning
This commit is contained in:
28
knowledge base/cloudquery.md
Normal file
28
knowledge base/cloudquery.md
Normal file
@@ -0,0 +1,28 @@
|
|||||||
|
# CloudQuery
|
||||||
|
|
||||||
|
TODO
|
||||||
|
|
||||||
|
1. [Further readings](#further-readings)
|
||||||
|
|
||||||
|
## Further readings
|
||||||
|
|
||||||
|
- [Website]
|
||||||
|
- [Github]
|
||||||
|
- [Documentation]
|
||||||
|
|
||||||
|
Alternatives:
|
||||||
|
|
||||||
|
- [Turbot Pipes]
|
||||||
|
|
||||||
|
<!--
|
||||||
|
Reference
|
||||||
|
═╬═Time══
|
||||||
|
-->
|
||||||
|
|
||||||
|
<!-- Knowledge base -->
|
||||||
|
[turbot pipes]: turbot%20pipes/README.md
|
||||||
|
|
||||||
|
<!-- Upstream -->
|
||||||
|
[documentation]: https://docs.cloudquery.io/docs
|
||||||
|
[github]: https://github.com/cloudquery/cloudquery
|
||||||
|
[website]: https://www.cloudquery.io/
|
||||||
@@ -1,31 +1,7 @@
|
|||||||
# Turbot pipes
|
# Turbot pipes
|
||||||
|
|
||||||
<!-- Remove this line to uncomment if needed
|
|
||||||
## Table of contents <!-- omit in toc -->
|
|
||||||
|
|
||||||
1. [TL;DR](#tldr)
|
|
||||||
1. [Further readings](#further-readings)
|
1. [Further readings](#further-readings)
|
||||||
|
|
||||||
## TL;DR
|
|
||||||
|
|
||||||
<!-- Uncomment if needed
|
|
||||||
<details>
|
|
||||||
<summary>Installation and configuration</summary>
|
|
||||||
</details>
|
|
||||||
-->
|
|
||||||
|
|
||||||
<!-- Uncomment if needed
|
|
||||||
<details>
|
|
||||||
<summary>Usage</summary>
|
|
||||||
</details>
|
|
||||||
-->
|
|
||||||
|
|
||||||
<!-- Uncomment if needed
|
|
||||||
<details>
|
|
||||||
<summary>Real world use cases</summary>
|
|
||||||
</details>
|
|
||||||
-->
|
|
||||||
|
|
||||||
## Further readings
|
## Further readings
|
||||||
|
|
||||||
- [Website]
|
- [Website]
|
||||||
@@ -33,19 +9,20 @@
|
|||||||
- [Powerpipe]
|
- [Powerpipe]
|
||||||
- [Steampipe]
|
- [Steampipe]
|
||||||
|
|
||||||
|
Alternatives:
|
||||||
|
|
||||||
|
- [CloudQuery]
|
||||||
|
|
||||||
<!--
|
<!--
|
||||||
Reference
|
Reference
|
||||||
═╬═Time══
|
═╬═Time══
|
||||||
-->
|
-->
|
||||||
|
|
||||||
<!-- In-article sections -->
|
|
||||||
<!-- Knowledge base -->
|
<!-- Knowledge base -->
|
||||||
|
[cloudquery]: ../cloudquery.md
|
||||||
[flowpipe]: flowpipe.md
|
[flowpipe]: flowpipe.md
|
||||||
[powerpipe]: powerpipe.md
|
[powerpipe]: powerpipe.md
|
||||||
[steampipe]: steampipe.md
|
[steampipe]: steampipe.md
|
||||||
|
|
||||||
<!-- Files -->
|
|
||||||
<!-- Upstream -->
|
<!-- Upstream -->
|
||||||
[website]: https://turbot.com/pipes
|
[website]: https://turbot.com/pipes
|
||||||
|
|
||||||
<!-- Others -->
|
|
||||||
|
|||||||
@@ -3,6 +3,7 @@
|
|||||||
Dynamically query APIs, code and more with SQL.
|
Dynamically query APIs, code and more with SQL.
|
||||||
|
|
||||||
1. [TL;DR](#tldr)
|
1. [TL;DR](#tldr)
|
||||||
|
1. [Export CLIs](#export-clis)
|
||||||
1. [Further readings](#further-readings)
|
1. [Further readings](#further-readings)
|
||||||
1. [Sources](#sources)
|
1. [Sources](#sources)
|
||||||
|
|
||||||
@@ -16,8 +17,8 @@ Default files directory (called _installation directory_ by Steampipe) is `$HOME
|
|||||||
```sh
|
```sh
|
||||||
brew install 'turbot/tap/steampipe'
|
brew install 'turbot/tap/steampipe'
|
||||||
|
|
||||||
steampipe completion fish | source
|
steampipe completion 'fish' | source
|
||||||
steampipe completion fish > "$HOME/.config/fish/completions/steampipe.fish"
|
steampipe completion 'fish' > "$HOME/.config/fish/completions/steampipe.fish"
|
||||||
|
|
||||||
# Disable telemetry.
|
# Disable telemetry.
|
||||||
export STEAMPIPE_TELEMETRY='none'
|
export STEAMPIPE_TELEMETRY='none'
|
||||||
@@ -27,6 +28,7 @@ export STEAMPIPE_TELEMETRY='none'
|
|||||||
# These are set to their defaults.
|
# These are set to their defaults.
|
||||||
export \
|
export \
|
||||||
STEAMPIPE_INSTALL_DIR="${HOME}/.steampipe" \
|
STEAMPIPE_INSTALL_DIR="${HOME}/.steampipe" \
|
||||||
|
STEAMPIPE_LOG_LEVEL="WARN" \
|
||||||
STEAMPIPE_MAX_PARALLEL=10 \
|
STEAMPIPE_MAX_PARALLEL=10 \
|
||||||
STEAMPIPE_MOD_LOCATION="$PWD" \
|
STEAMPIPE_MOD_LOCATION="$PWD" \
|
||||||
STEAMPIPE_UPDATE_CHECK=true
|
STEAMPIPE_UPDATE_CHECK=true
|
||||||
@@ -116,6 +118,59 @@ Dashboards and Mods have been deprecated in favour of [Powerpipe]. Use it instea
|
|||||||
|
|
||||||
</details>
|
</details>
|
||||||
|
|
||||||
|
## Export CLIs
|
||||||
|
|
||||||
|
Every Steampipe plugin is distributed as a distinct Steampipe Export CLI.<br/>
|
||||||
|
It is available for download in the Releases page for the corresponding plugin's repository.
|
||||||
|
|
||||||
|
Download, extract, and install the file.<br/>
|
||||||
|
An install script is available for ease of use:
|
||||||
|
|
||||||
|
```sh
|
||||||
|
$ /bin/sh -c "$(curl -fsSL https://steampipe.io/install/export.sh)"
|
||||||
|
Enter the plugin name: aws
|
||||||
|
Enter the version (latest):
|
||||||
|
Enter location (/usr/local/bin):
|
||||||
|
Created temporary directory at /var/folders/t4/1lm46wt12sv7yq1gp1swn3jr0000gn/T/tmp.RpZLlzs2.
|
||||||
|
|
||||||
|
Downloading steampipe_export_aws.darwin_arm64.tar.gz...
|
||||||
|
######################################################################### 100.0%
|
||||||
|
Deflating downloaded archive
|
||||||
|
x steampipe_export_aws
|
||||||
|
Installing
|
||||||
|
Applying necessary permissions
|
||||||
|
Removing downloaded archive
|
||||||
|
steampipe_export_aws was installed successfully to /usr/local/bin
|
||||||
|
```
|
||||||
|
|
||||||
|
The output can be in CSV (default), JSON or [JSONL](https://jsonlines.org/).
|
||||||
|
|
||||||
|
```sh
|
||||||
|
$ steampipe_export_aws 'aws_account' --output 'json'
|
||||||
|
2024/05/24 12:03:53 [INFO] Memoize getBaseClientForAccountUncached
|
||||||
|
…
|
||||||
|
2024/05/24 12:03:53 [INFO] Memoize 0x109fed0c0 listRegionsForServiceUncached
|
||||||
|
[{
|
||||||
|
"_ctx": "{\"connection_name\":\"aws\",\"steampipe\":{\"sdk_version\":\"5.10.0\"}}",
|
||||||
|
"account_aliases": "[\"exampleOrg\"]",
|
||||||
|
"account_id": "012345678901",
|
||||||
|
"akas": "[\"arn:aws:::012345678901\"]",
|
||||||
|
"arn": "arn:aws:::012345678901",
|
||||||
|
"organization_arn": "arn:aws:organizations::012345678901:organization/o-p42ybyw9ml",
|
||||||
|
"organization_available_policy_types": "[{\"Status\":\"ENABLED\",\"Type\":\"SERVICE_CONTROL_POLICY\"}]",
|
||||||
|
"organization_feature_set": "ALL",
|
||||||
|
"organization_id": "o-p42ybyw9ml",
|
||||||
|
"organization_master_account_arn": "arn:aws:organizations::012345678901:account/o-p42ybyw9ml/012345678901",
|
||||||
|
"organization_master_account_email": "user@example.org",
|
||||||
|
"organization_master_account_id": "012345678901",
|
||||||
|
"partition": "aws",
|
||||||
|
"region": "global",
|
||||||
|
"sp_connection_name": "aws",
|
||||||
|
"sp_ctx": "{\"connection_name\":\"aws\",\"steampipe\":{\"sdk_version\":\"5.10.0\"}}",
|
||||||
|
"title": "exampleOrg"
|
||||||
|
}]
|
||||||
|
```
|
||||||
|
|
||||||
## Further readings
|
## Further readings
|
||||||
|
|
||||||
- [Website]
|
- [Website]
|
||||||
@@ -123,6 +178,8 @@ Dashboards and Mods have been deprecated in favour of [Powerpipe]. Use it instea
|
|||||||
- [Steampipe unbundled]
|
- [Steampipe unbundled]
|
||||||
- [Flowpipe]
|
- [Flowpipe]
|
||||||
- [Powerpipe]
|
- [Powerpipe]
|
||||||
|
- [Steampipe and Postgres]
|
||||||
|
- [Connecting Steampipe with Google BigQuery]
|
||||||
|
|
||||||
### Sources
|
### Sources
|
||||||
|
|
||||||
@@ -134,13 +191,11 @@ Dashboards and Mods have been deprecated in favour of [Powerpipe]. Use it instea
|
|||||||
═╬═Time══
|
═╬═Time══
|
||||||
-->
|
-->
|
||||||
|
|
||||||
<!-- In-article sections -->
|
|
||||||
<!-- Knowledge base -->
|
<!-- Knowledge base -->
|
||||||
[flowpipe]: flowpipe.md
|
[flowpipe]: flowpipe.md
|
||||||
[powerpipe]: powerpipe.md
|
[powerpipe]: powerpipe.md
|
||||||
[turbot pipes]: README.md
|
[turbot pipes]: README.md
|
||||||
|
|
||||||
<!-- Files -->
|
|
||||||
<!-- Upstream -->
|
<!-- Upstream -->
|
||||||
[documentation]: https://steampipe.io/docs
|
[documentation]: https://steampipe.io/docs
|
||||||
[github]: https://github.com/turbot/steampipe
|
[github]: https://github.com/turbot/steampipe
|
||||||
@@ -148,3 +203,5 @@ Dashboards and Mods have been deprecated in favour of [Powerpipe]. Use it instea
|
|||||||
[website]: https://steampipe.io/
|
[website]: https://steampipe.io/
|
||||||
|
|
||||||
<!-- Others -->
|
<!-- Others -->
|
||||||
|
[connecting steampipe with google bigquery]: https://briansuk.medium.com/connecting-steampipe-with-google-bigquery-ae37f258090f
|
||||||
|
[steampipe and postgres]: https://www.reddit.com/r/aws/comments/uh8w9k/steampipe_and_postgres/
|
||||||
|
|||||||
Reference in New Issue
Block a user