Skip to main content

Amazon CloudFront Integration (Data Firehose) Setup Guide

Overview

Amazon CloudFront Integration allows you to forward real-time website traffic logs to Website Analytics. These logs help monitor how AI platforms crawl, interpret, and interact with your website content.

Using Amazon Data Firehose, log data can be securely streamed to the Website Analytics ingestion endpoint for processing and reporting.

For more information about CloudFront real-time logs, refer to the official AWS documentation.

Prerequisites

Before you begin, ensure you have:

  • An AWS account with access to CloudFront and Amazon Data Firehose

  • Permission to manage CloudFront distributions and streaming configurations

  • Your Website Analytics Key and Endpoint from the Birdeye dashboard

  • Access to your CDN or server configuration settings

Configuration

Before configuring Amazon CloudFront, make sure Website Analytics is already set up in Birdeye.

To learn how to configure Website Analytics, refer to the article: How to Configure Website Analytics and View Setup Guides.

You can then use the setup details provided in the Birdeye dashboard to complete the Amazon CloudFront integration.

Step 1: Open Amazon Data Firehose in AWS

  1. Sign in to your AWS Management Console.

  2. In the search bar, search for Amazon Data Firehose.

  3. Open the Amazon Data Firehose service from the results.

This service will be used to stream CloudFront real-time logs to Website Analytics.

Step 2: Configure the Delivery Stream

In Amazon Data Firehose, create a new delivery stream and configure it to receive data using Direct PUT. Then set the destination type to HTTP Endpoint so logs can be forwarded to Website Analytics.

Step 3: Configure the HTTP Endpoint

In the HTTP Endpoint configuration, enter the Website Analytics ingestion endpoint provided in the Birdeye dashboard.

Next, configure authentication using your Website Analytics Key as the access token. For improved security, Birdeye recommends storing the token using AWS Secrets Manager.

If you are using AWS Secrets Manager, create the secret using the appropriate JSON format required by your AWS configuration.

  • Under Content encoding, select GZIP to compress log data before it is delivered to Website Analytics.

  • Set the retry duration based on your organization’s preference or continue with the default AWS recommendation.

  • Leave the optional parameter fields unchanged unless additional customization is required.

Configure Backup Storage for Failed Deliveries

  • Under Source record backup in Amazon S3, select Failed data only.

  • Choose an existing S3 bucket or create a new bucket to store failed delivery logs.

Step 4: Configure CloudFront Log Delivery

  • Open your CloudFront distribution in AWS and navigate to the Logging tab.

  • Click Add to create a new log destination.

  • From the dropdown menu, select Amazon Kinesis Data Firehose as the destination type.

  • Select the Firehose delivery stream created in the previous steps.

This configuration enables CloudFront real-time logs to be streamed to Website Analytics through Amazon Data Firehose.

Step 5: Select the Firehose Delivery Stream

  1. On the Add standard logging destination screen, verify that Amazon Kinesis Data Firehose is selected as the delivery destination.

  2. Under Destination stream, select the Firehose delivery stream created earlier in Step 2.

Under Additional settings, select the following log fields to ensure Website Analytics receives the required request and response data from CloudFront logs.

Field

Description

date

Date when the request was processed

time

Time when the request was processed

c-ip

Client IP address

cs-method

HTTP request method

x-host-header

Host header value

cs-uri-stem

Requested URL path

cs-uri-query

URL query parameters

cs(User-Agent)

Browser or crawler user agent

cs(Referer)

Referrer source

sc-status

HTTP response status code

sc-bytes

Response size in bytes

time-taken

Total request processing time

These fields help Website Analytics understand traffic patterns, crawler behavior, request sources, and response performance across your website.

Step 6: Select the Output Format

Under Output format, select JSON from the dropdown menu.

JSON formatting ensures CloudFront logs are structured correctly for Website Analytics ingestion and processing.

Once selected, click Submit to save the logging destination configuration.

Did this answer your question?