From e1e67c3708b25f70af3c6ca6e345a5a786be11fe Mon Sep 17 00:00:00 2001 From: Michele Cereda Date: Tue, 18 Jun 2024 23:04:28 +0200 Subject: [PATCH] chore(kb/aws): extend rds notes --- knowledge base/acronyms and abbreviations.md | 1 + knowledge base/cloud computing/aws/README.md | 19 +++++++++++++++++-- 2 files changed, 18 insertions(+), 2 deletions(-) diff --git a/knowledge base/acronyms and abbreviations.md b/knowledge base/acronyms and abbreviations.md index e1a4e8a..f6d74d6 100644 --- a/knowledge base/acronyms and abbreviations.md +++ b/knowledge base/acronyms and abbreviations.md @@ -43,6 +43,7 @@ | ELI5 | Explain Like I'm 5 | | | ESS | Extended Service Set | Group of WAPs working together to offer the same wireless network | | ESSID | Extended Service Set IDentifier | The wireless network name shared in an ESS | +| ETL | Extract, Transform and Load | The process of combining data from multiple sources into a large, central data warehouse | | FHS | [Filesystem Hierarchy Standard][fhs] | | | FIFO | First In First Out | | | FILO | First In Last Out | | diff --git a/knowledge base/cloud computing/aws/README.md b/knowledge base/cloud computing/aws/README.md index dde5d8a..6a36813 100644 --- a/knowledge base/cloud computing/aws/README.md +++ b/knowledge base/cloud computing/aws/README.md @@ -191,6 +191,17 @@ One can choose any of the following retention periods for instances' Performance - _n_ months, where n is a number from 1 to 24.
In CLI and IaC, this number must be _n*31_. +One can export DB snapshot data to [S3] buckets. + +The export process runs in the background and does **not** affect the performance of active DB instances. + +RDS extracts data from snapshots and stores it in Apache Parquet format.
+By default, **all** data in the snapshots is exported; one can export specific sets of databases, schemas, or tables. + +After the export, one can analyze the data directly through +[Athena](https://docs.aws.amazon.com/athena/latest/ug/parquet-serde.html) or +[Redshift Spectrum](https://docs.aws.amazon.com/redshift/latest/dg/copy-usage_notes-copy-from-columnar.html). + ### Security Hub FIXME @@ -349,6 +360,8 @@ Examples: - [Introduction to backups][rds introduction to backups] for RDS - [Pricing and data retention for Performance Insights][rds pricing and data retention for performance insights] for RDS +- [Exporting DB snapshot data to Amazon S3] +- [I'm trying to export a snapshot from Amazon RDS MySQL to Amazon S3, but I'm receiving an error. Why is this happening?] [access aws services through aws privatelink]: https://docs.aws.amazon.com/vpc/latest/privatelink/privatelink-access-aws-services.html [assumerole api reference]: https://docs.aws.amazon.com/STS/latest/APIReference/API_AssumeRole.html +[aws icons]: https://aws-icons.com/ [aws json policy elements: principal]: https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_elements_principal.html [best practices for tagging aws resources]: https://docs.aws.amazon.com/whitepapers/latest/tagging-best-practices/tagging-best-practices.html [connect to the internet using an internet gateway]: https://docs.aws.amazon.com/vpc/latest/userguide/VPC_Internet_Gateway.html [constraints tag]: https://docs.aws.amazon.com/directoryservice/latest/devguide/API_Tag.html [creating a role to delegate permissions to an iam user]: https://docs.aws.amazon.com/IAM/latest/UserGuide/id_roles_create_for-user.html [elastic ip addresses]: https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/elastic-ip-addresses-eip.html +[exporting db snapshot data to amazon s3]: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_ExportSnapshot.html [how can i monitor the account activity of specific iam users, roles, and aws access keys?]: https://repost.aws/knowledge-center/view-iam-history [how to use the passrole permission with iam roles]: https://aws.amazon.com/blogs/security/how-to-use-the-passrole-permission-with-iam-roles/ +[i'm trying to export a snapshot from amazon rds mysql to amazon s3, but i'm receiving an error. why is this happening?]: https://repost.aws/knowledge-center/rds-mysql-export-snapshot [iam json policy elements: sid]: https://docs.aws.amazon.com/IAM/latest/UserGuide/reference_policies_elements_sid.html [nat gateways]: https://docs.aws.amazon.com/vpc/latest/userguide/vpc-nat-gateway.html +[not authorized to perform: sts:assumerole]: https://repost.aws/questions/QUOY5XngCtRyOX4Desaygz8Q/not-authorized-to-perform-sts-assumerole [rds introduction to backups]: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_WorkingWithAutomatedBackups.html [rds pricing and data retention for performance insights]: https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/USER_PerfInsights.Overview.cost.html [services that publish cloudwatch metrics]: https://docs.aws.amazon.com/AmazonCloudWatch/latest/monitoring/aws-services-cloudwatch-metrics.html @@ -407,10 +424,8 @@ Examples: [automating dns-challenge based letsencrypt certificates with aws route 53]: https://johnrix.medium.com/automating-dns-challenge-based-letsencrypt-certificates-with-aws-route-53-8ba799dd207b [aws config tutorial by stephane maarek]: https://www.youtube.com/watch?v=qHdFoYSrUvk -[aws icons]: https://aws-icons.com/ [aws.permissions.cloud]: https://aws.permissions.cloud/ [configuring ec2 disk alert using amazon cloudwatch]: https://medium.com/@chandinims001/configuring-ec2-disk-alert-using-amazon-cloudwatch-793807e40d72 [date & time policy conditions at aws - 1-minute iam lesson]: https://www.youtube.com/watch?v=4wpKP1HLEXg [introduction to aws iam assumerole]: https://aws.plainenglish.io/introduction-to-aws-iam-assumerole-fbef3ce8e90b -[not authorized to perform: sts:assumerole]: https://repost.aws/questions/QUOY5XngCtRyOX4Desaygz8Q/not-authorized-to-perform-sts-assumerole [you might be clueless as to why aws assume role isn't working, despite being correctly set up]: https://medium.com/@kamal.maiti/you-might-be-clueless-as-to-why-aws-assume-role-isnt-working-despite-being-correctly-set-up-1b3138519c07