AWS：Amazon Web Services¶

Airflow 支持 Amazon Web Services。

所有挂钩都基于 airflow.providers.amazon.aws.hooks.base_aws。

服务¶

这些集成允许你在 Amazon Web Services 中执行各种操作。

传输¶

这些集成允许您从/向 Amazon Web Services 复制数据。

Amazon DynamoDB 到 Amazon Simple Storage Service (S3)¶

源产品文档: Amazon DynamoDB
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Amazon DynamoDB 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.dynamodb_to_s3
提供商: apache-airflow-providers-amazon

Google Cloud Storage (GCS) 到 Amazon Simple Storage Service (S3)¶

源产品文档: Google Cloud Storage (GCS)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Google Cloud Storage 到 Amazon S3 传输操作符
Python API: airflow.providers.amazon.aws.transfers.gcs_to_s3
提供商: apache-airflow-providers-amazon

Amazon Glacier 到 Google Cloud Storage (GCS)¶

源产品文档: Amazon Glacier
目标产品文档: Google Cloud Storage (GCS)
操作指南: Amazon S3 Glacier 到 GCS
Python API: airflow.providers.amazon.aws.transfers.glacier_to_gcs
提供商: apache-airflow-providers-amazon

Google 到 Amazon Simple Storage Service (S3)¶

源产品文档: Google
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Google API 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.google_api_to_s3
提供商: apache-airflow-providers-amazon

Apache Hive 到 Amazon DynamoDB¶

源产品文档: Apache Hive
目标产品文档: Amazon DynamoDB
操作指南: Apache Hive 到 Amazon DynamoDB
Python API: airflow.providers.amazon.aws.transfers.hive_to_dynamodb
提供商: apache-airflow-providers-amazon

超文本传输协议 (HTTP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: 超文本传输协议 (HTTP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: HTTP 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.http_to_s3
提供商: apache-airflow-providers-amazon

互联网邮件访问协议 (IMAP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: 互联网邮件访问协议 (IMAP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Imap 附件到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.imap_attachment_to_s3
提供商: apache-airflow-providers-amazon

MongoDB 到 Amazon Simple Storage Service (S3)¶

源产品文档: MongoDB
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: MongoDB 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.mongo_to_s3
提供商: apache-airflow-providers-amazon

Amazon Redshift 到 Amazon Simple Storage Service (S3)¶

源产品文档: Amazon Redshift
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Amazon Redshift 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.redshift_to_s3
提供商: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到 Amazon Redshift¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Amazon Redshift
操作指南: Amazon S3 到 Amazon Redshift
Python API: airflow.providers.amazon.aws.transfers.s3_to_redshift
提供商: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到 SSH 文件传输协议 (SFTP)¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: SSH 文件传输协议 (SFTP)
操作指南: Amazon S3 到 SFTP
Python API: airflow.providers.amazon.aws.transfers.s3_to_sftp
提供商: apache-airflow-providers-amazon

SSH 文件传输协议 (SFTP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: SSH 文件传输协议 (SFTP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: SFTP 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.sftp_to_s3
提供商: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到文件传输协议 (FTP)¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: 文件传输协议 (FTP)
操作指南: Amazon S3 到 FTP
Python API: airflow.providers.amazon.aws.transfers.s3_to_ftp
提供商: apache-airflow-providers-amazon

Exasol 到 Amazon Simple Storage Service (S3)¶

源产品文档: Exasol
目标产品文档: Amazon Simple Storage Service (S3)
Python API: airflow.providers.amazon.aws.transfers.exasol_to_s3
提供商: apache-airflow-providers-amazon

文件传输协议 (FTP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: 文件传输协议 (FTP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: FTP 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.ftp_to_s3
提供商: apache-airflow-providers-amazon

Salesforce 到 Amazon Simple Storage Service (S3)¶

源产品文档: Salesforce
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Salesforce 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.salesforce_to_s3
提供商: apache-airflow-providers-amazon

本地到 Amazon Simple Storage Service (S3)¶

目标产品文档: Amazon Simple Storage Service (S3)
操作指南: 本地文件系统到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.local_to_s3
提供商: apache-airflow-providers-amazon

通用 SQL 到 Amazon Simple Storage Service (S3)¶

源产品文档: 通用 SQL
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: SQL 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.sql_to_s3
提供商: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到通用 SQL¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: 通用 SQL
操作指南: Amazon S3 到 SQL
Python API: airflow.providers.amazon.aws.transfers.s3_to_sql
提供商: apache-airflow-providers-amazon

Amazon Web Services 到 Amazon Web Services¶

源产品文档: Amazon Web Services
目标产品文档: Amazon Web Services
Python API: airflow.providers.amazon.aws.transfers.base
提供商: apache-airflow-providers-amazon

Microsoft Azure Blob 存储到 Amazon Simple Storage Service (S3)¶

源产品文档: Microsoft Azure Blob 存储
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Azure Blob 存储到 Amazon S3 传输操作符
Python API: airflow.providers.amazon.aws.transfers.azure_blob_to_s3
提供商: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到 Amazon DynamoDB¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Amazon DynamoDB
操作指南: Amazon S3 到 DynamoDB
Python API: airflow.providers.amazon.aws.transfers.s3_to_dynamodb
提供商: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 至 Apache Hive¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Apache Hive
Python API: airflow.providers.apache.hive.transfers.s3_to_hive
提供商: apache-airflow-providers-apache-hive

Amazon Simple Storage Service (S3) 至 Google Cloud Storage (GCS)¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Google Cloud Storage (GCS)
操作指南: 将数据从 Amazon S3 传输到 Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.s3_to_gcs
提供商: apache-airflow-providers-google

Amazon Simple Storage Service (S3) 至 MySQL¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: MySQL
Python API: airflow.providers.mysql.transfers.s3_to_mysql
提供商: apache-airflow-providers-mysql

Amazon Simple Storage Service (S3) 至 Snowflake¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Snowflake
操作指南: CopyFromExternalStageToSnowflakeOperator
Python API: airflow.providers.snowflake.transfers.copy_into_snowflake
提供商: apache-airflow-providers-snowflake

Amazon Simple Storage Service (S3) 至 Teradata¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Teradata
操作指南: S3ToTeradataOperator
Python API: airflow.providers.teradata.transfers.s3_to_teradata
提供商: apache-airflow-providers-teradata

AWS：Amazon Web Services¶

服务¶

Amazon Appflow¶

Amazon Athena¶

Amazon Bedrock¶

Amazon Chime¶

Amazon CloudFormation¶

Amazon CloudWatch Logs¶

Amazon Comprehend¶

Amazon DataSync¶

Amazon DynamoDB¶

Amazon EC2¶

Amazon ECS¶

Amazon Elastic Container Registry (ECR)¶

Amazon Elastic Kubernetes Service (EKS)¶

Amazon ElastiCache¶

Amazon EMR¶

Amazon EMR on EKS¶

Amazon EventBridge¶

Amazon Glacier¶

Amazon Kinesis Data Firehose¶

Amazon Neptune¶

Amazon OpenSearch Serverless¶

Amazon QuickSight¶

Amazon RDS¶

Amazon Redshift¶

Amazon SageMaker¶

Amazon SecretsManager¶

Amazon Simple Email Service (SES)¶

Amazon Simple Notification Service (SNS)¶

Amazon Simple Queue Service (SQS)¶

Amazon Simple Storage Service (S3)¶

Amazon Systems Manager (SSM)¶

Amazon Verified Permissions¶

Amazon Web Services¶

AWS Batch¶

AWS Database Migration Service¶

AWS Glue¶

AWS Glue DataBrew¶

AWS Lambda¶

AWS 安全令牌服务 (STS)¶

AWS Step Functions¶

传输¶

Amazon DynamoDB 到 Amazon Simple Storage Service (S3)¶

Google Cloud Storage (GCS) 到 Amazon Simple Storage Service (S3)¶

Amazon Glacier 到 Google Cloud Storage (GCS)¶

Google 到 Amazon Simple Storage Service (S3)¶

Apache Hive 到 Amazon DynamoDB¶

超文本传输协议 (HTTP) 到 Amazon Simple Storage Service (S3)¶

互联网邮件访问协议 (IMAP) 到 Amazon Simple Storage Service (S3)¶

MongoDB 到 Amazon Simple Storage Service (S3)¶

Amazon Redshift 到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到 Amazon Redshift¶

Amazon Simple Storage Service (S3) 到 SSH 文件传输协议 (SFTP)¶

SSH 文件传输协议 (SFTP) 到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到文件传输协议 (FTP)¶

Exasol 到 Amazon Simple Storage Service (S3)¶

文件传输协议 (FTP) 到 Amazon Simple Storage Service (S3)¶

Salesforce 到 Amazon Simple Storage Service (S3)¶

本地到 Amazon Simple Storage Service (S3)¶

通用 SQL 到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到通用 SQL¶

Amazon Web Services 到 Amazon Web Services¶

Microsoft Azure Blob 存储到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到 Amazon DynamoDB¶

Amazon Simple Storage Service (S3) 至 Apache Hive¶

Amazon Simple Storage Service (S3) 至 Google Cloud Storage (GCS)¶

Amazon Simple Storage Service (S3) 至 MySQL¶

Amazon Simple Storage Service (S3) 至 Snowflake¶

Amazon Simple Storage Service (S3) 至 Teradata¶