AWS：亚马逊网络服务¶

Airflow 支持亚马逊网络服务。

所有钩子都基于 airflow.providers.amazon.aws.hooks.base_aws。

服务¶

这些集成允许您在亚马逊网络服务中执行各种操作。

传输¶

这些集成允许您从/向 Amazon Web Services 复制数据。

Amazon DynamoDB 到 Amazon Simple Storage Service (S3)¶

源产品文档: Amazon DynamoDB
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Amazon DynamoDB 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.dynamodb_to_s3
提供程序: apache-airflow-providers-amazon

Google Cloud Storage (GCS) 到 Amazon Simple Storage Service (S3)¶

源产品文档: Google Cloud Storage (GCS)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Google Cloud Storage 到 Amazon S3 传输操作符
Python API: airflow.providers.amazon.aws.transfers.gcs_to_s3
提供程序: apache-airflow-providers-amazon

Amazon Glacier 到 Google Cloud Storage (GCS)¶

源产品文档: Amazon Glacier
目标产品文档: Google Cloud Storage (GCS)
操作指南: Amazon S3 Glacier 到 GCS
Python API: airflow.providers.amazon.aws.transfers.glacier_to_gcs
提供程序: apache-airflow-providers-amazon

Google 到 Amazon Simple Storage Service (S3)¶

源产品文档: Google
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Google API 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.google_api_to_s3
提供程序: apache-airflow-providers-amazon

Apache Hive 到 Amazon DynamoDB¶

源产品文档: Apache Hive
目标产品文档: Amazon DynamoDB
操作指南: Apache Hive 到 Amazon DynamoDB
Python API: airflow.providers.amazon.aws.transfers.hive_to_dynamodb
提供程序: apache-airflow-providers-amazon

超文本传输协议 (HTTP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: 超文本传输协议 (HTTP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: HTTP 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.http_to_s3
提供程序: apache-airflow-providers-amazon

Internet 消息访问协议 (IMAP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: Internet 消息访问协议 (IMAP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Imap 附件到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.imap_attachment_to_s3
提供程序: apache-airflow-providers-amazon

MongoDB 到 Amazon Simple Storage Service (S3)¶

源产品文档: MongoDB
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: MongoDB 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.mongo_to_s3
提供程序: apache-airflow-providers-amazon

Amazon Redshift 到 Amazon Simple Storage Service (S3)¶

源产品文档: Amazon Redshift
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Amazon Redshift 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.redshift_to_s3
提供程序: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到 Amazon Redshift¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Amazon Redshift
操作指南: Amazon S3 到 Amazon Redshift
Python API: airflow.providers.amazon.aws.transfers.s3_to_redshift
提供程序: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到 SSH 文件传输协议 (SFTP)¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: SSH 文件传输协议 (SFTP)
操作指南: Amazon S3 到 SFTP
Python API: airflow.providers.amazon.aws.transfers.s3_to_sftp
提供程序: apache-airflow-providers-amazon

SSH 文件传输协议 (SFTP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: SSH 文件传输协议 (SFTP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: SFTP 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.sftp_to_s3
提供程序: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到文件传输协议 (FTP)¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: 文件传输协议 (FTP)
操作指南: Amazon S3 到 FTP
Python API: airflow.providers.amazon.aws.transfers.s3_to_ftp
提供程序: apache-airflow-providers-amazon

Exasol 到 Amazon Simple Storage Service (S3)¶

源产品文档: Exasol
目标产品文档: Amazon Simple Storage Service (S3)
Python API: airflow.providers.amazon.aws.transfers.exasol_to_s3
提供程序: apache-airflow-providers-amazon

文件传输协议 (FTP) 到 Amazon Simple Storage Service (S3)¶

源产品文档: 文件传输协议 (FTP)
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: FTP 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.ftp_to_s3
提供程序: apache-airflow-providers-amazon

Salesforce 到 Amazon Simple Storage Service (S3)¶

源产品文档: Salesforce
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Salesforce 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.salesforce_to_s3
提供程序: apache-airflow-providers-amazon

本地到 Amazon Simple Storage Service (S3)¶

目标产品文档: Amazon Simple Storage Service (S3)
操作指南: 本地文件系统到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.local_to_s3
提供程序: apache-airflow-providers-amazon

通用 SQL 到 Amazon Simple Storage Service (S3)¶

源产品文档: 通用 SQL
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: SQL 到 Amazon S3
Python API: airflow.providers.amazon.aws.transfers.sql_to_s3
提供程序: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到通用 SQL¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: 通用 SQL
操作指南: Amazon S3 到 SQL
Python API: airflow.providers.amazon.aws.transfers.s3_to_sql
提供程序: apache-airflow-providers-amazon

Amazon Web Services 到 Amazon Web Services¶

源产品文档: 亚马逊网络服务
目标产品文档: 亚马逊网络服务
Python API: airflow.providers.amazon.aws.transfers.base
提供程序: apache-airflow-providers-amazon

Microsoft Azure Blob Storage 到 Amazon Simple Storage Service (S3)¶

源产品文档: Microsoft Azure Blob Storage
目标产品文档: Amazon Simple Storage Service (S3)
操作指南: Azure Blob Storage 到 Amazon S3 传输操作符
Python API: airflow.providers.amazon.aws.transfers.azure_blob_to_s3
提供程序: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到 Amazon DynamoDB¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Amazon DynamoDB
操作指南: Amazon S3 到 DynamoDB
Python API: airflow.providers.amazon.aws.transfers.s3_to_dynamodb
提供程序: apache-airflow-providers-amazon

Amazon Simple Storage Service (S3) 到 Apache Hive¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Apache Hive
Python API: airflow.providers.apache.hive.transfers.s3_to_hive
提供程序: apache-airflow-providers-apache-hive

Amazon Simple Storage Service (S3) 到 Google Cloud Storage (GCS)¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Google Cloud Storage (GCS)
操作指南: 从 Amazon S3 传输数据到 Google Cloud Storage
Python API: airflow.providers.google.cloud.transfers.s3_to_gcs
提供程序: apache-airflow-providers-google

Amazon Simple Storage Service (S3) 到 Microsoft Azure Blob Storage¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Microsoft Azure Blob Storage
操作指南: Amazon S3 到 Azure Blob Storage 传输操作符
Python API: airflow.providers.microsoft.azure.transfers.s3_to_wasb
提供程序: apache-airflow-providers-microsoft-azure

Amazon Simple Storage Service (S3) 到 MySQL¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: MySQL
Python API: airflow.providers.mysql.transfers.s3_to_mysql
提供程序: apache-airflow-providers-mysql

Amazon Simple Storage Service (S3) 到 Snowflake¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Snowflake
操作指南: CopyFromExternalStageToSnowflakeOperator
Python API: airflow.providers.snowflake.transfers.copy_into_snowflake
提供程序: apache-airflow-providers-snowflake

Amazon Simple Storage Service (S3) 到 Teradata¶

源产品文档: Amazon Simple Storage Service (S3)
目标产品文档: Teradata
操作指南: S3ToTeradataOperator
Python API: airflow.providers.teradata.transfers.s3_to_teradata
提供程序: apache-airflow-providers-teradata

AWS：亚马逊网络服务¶

服务¶

Amazon Appflow¶

Amazon Athena¶

Amazon Bedrock¶

Amazon Chime¶

Amazon CloudFormation¶

Amazon CloudWatch Logs¶

Amazon Comprehend¶

Amazon DataSync¶

Amazon DynamoDB¶

Amazon EC2¶

Amazon ECS¶

Amazon Elastic Container Registry (ECR)¶

Amazon Elastic Kubernetes Service (EKS)¶

Amazon ElastiCache¶

Amazon EMR¶

Amazon EMR on EKS¶

Amazon EventBridge¶

Amazon Glacier¶

Amazon Kinesis Data Firehose¶

Amazon Managed Service for Apache Flink¶

Amazon Neptune¶

Amazon OpenSearch Serverless¶

Amazon QuickSight¶

Amazon RDS¶

Amazon Redshift¶

Amazon SageMaker¶

Amazon SecretsManager¶

Amazon Simple Email Service (SES)¶

Amazon Simple Notification Service (SNS)¶

Amazon Simple Queue Service (SQS)¶

Amazon Simple Storage Service (S3)¶

Amazon Systems Manager (SSM)¶

Amazon Verified Permissions¶

亚马逊网络服务¶

AWS Batch¶

AWS Database Migration Service¶

AWS Glue¶

AWS Glue DataBrew¶

AWS Lambda¶

AWS Security Token Service (STS)¶

AWS Step Functions¶

传输¶

Amazon DynamoDB 到 Amazon Simple Storage Service (S3)¶

Google Cloud Storage (GCS) 到 Amazon Simple Storage Service (S3)¶

Amazon Glacier 到 Google Cloud Storage (GCS)¶

Google 到 Amazon Simple Storage Service (S3)¶

Apache Hive 到 Amazon DynamoDB¶

超文本传输协议 (HTTP) 到 Amazon Simple Storage Service (S3)¶

Internet 消息访问协议 (IMAP) 到 Amazon Simple Storage Service (S3)¶

MongoDB 到 Amazon Simple Storage Service (S3)¶

Amazon Redshift 到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到 Amazon Redshift¶

Amazon Simple Storage Service (S3) 到 SSH 文件传输协议 (SFTP)¶

SSH 文件传输协议 (SFTP) 到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到文件传输协议 (FTP)¶

Exasol 到 Amazon Simple Storage Service (S3)¶

文件传输协议 (FTP) 到 Amazon Simple Storage Service (S3)¶

Salesforce 到 Amazon Simple Storage Service (S3)¶

本地到 Amazon Simple Storage Service (S3)¶

通用 SQL 到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到通用 SQL¶

Amazon Web Services 到 Amazon Web Services¶

Microsoft Azure Blob Storage 到 Amazon Simple Storage Service (S3)¶

Amazon Simple Storage Service (S3) 到 Amazon DynamoDB¶

Amazon Simple Storage Service (S3) 到 Apache Hive¶

Amazon Simple Storage Service (S3) 到 Google Cloud Storage (GCS)¶

Amazon Simple Storage Service (S3) 到 Microsoft Azure Blob Storage¶

Amazon Simple Storage Service (S3) 到 MySQL¶

Amazon Simple Storage Service (S3) 到 Snowflake¶

Amazon Simple Storage Service (S3) 到 Teradata¶