Hydrolix / Akamai Traffic Peak Plugin

This plugin pushes request/response logs to Hydrolix AKA Akamai Traffic Peak.

Setup

You can define the fields created in the JSON object by creating a custom type in TypeScript and a function to extract the field data from the Response, ZuploRequest, and ZuploContext.

The plugin is configured in the Runtime Extensions file zuplo.runtime.ts:

This logger includes a default type and function that logs the following fields:

• deploymentName string - The name of the deployment.
• timestamp string - The time the log was created.
• requestId string - The UUID of the request (the value of the zp-rid header).
• routePath string - The path of the route.
• operationId string | undefined - The operation ID.
• url string | undefined - The URL of the request.
• statusCode number | undefined - The status code of the response.
• durationMs number | undefined - The duration of the request in milliseconds.
• method string - The HTTP method of the request.
• userSub string | undefined - The user sub.
• instanceId string | undefined - The instance ID.
• colo string | undefined - The colo (datacenter) of the request.
• city string | undefined - The city the request origin.
• country string | undefined - The country the request origin.
• continent string | undefined - The continent the request origin.
• latitude string | undefined - The latitude of the request origin.
• longitude string | undefined - The longitude of the request origin.
• postalCode string | undefined - The postal code of the request origin.
• metroCode string | undefined - The metro code of the request origin.
• region string | undefined - The region of the request origin.
• regionCode string | undefined - The region code of the request origin.
• timezone string | undefined - The timezone of the request origin.
• asn string | undefined - The ASN of the request origin.
• asOrganization string | undefined - The AS organization of the request origin.
• clientIP string | undefined - The client IP of the requestor.
• zuploUserAgent string | undefined - The Zuplo user agent.

To use this default setup add the following code to your zuplo.runtime.ts file:

modules/zuplo.runtime.ts
 
import {
  ZuploRequest,
  HydrolixRequestLoggerPlugin,
  HydrolixDefaultEntry,
  environment,
} from "@zuplo/runtime";

import {
  environment,
  HydrolixRequestLoggerPlugin,
  HydrolixDefaultEntry,
  defaultGenerateHydrolixEntry,
} from "@zuplo/runtime";

export function runtimeInit(runtime: RuntimeExtensions) {
  runtime.addPlugin(
    new HydrolixRequestLoggerPlugin<HydrolixDefaultEntry>({
      hostname: "your-hydrolix-hostname.com",
      username: "your-hydrolix-username",
      password: environment.HYDROLIX_PASSWORD,
      token: environment.HYDROLIX_TOKEN,
      table: "your-table.name",
      transform: "your-transform-name",
      generateLogEntry: defaultGenerateHydrolixEntry,
    }),
  );
}

Note, the token (HYDROLIX_TOKEN above) is a Streaming Auth Token.

If you want to customize the data written to Hydrolix, you can define the fields and entry generation function yourself as follows:

modules/zuplo.runtime.ts
 
import {
  ZuploRequest,
  HydrolixRequestLoggerPlugin,
  environment,
} from "@zuplo/runtime";

// The interface that describes the rows
// in the output
interface LogEntry {
  timestamp: string;
  method: string;
  url: string;
  status: number;
  statusText: string;
  sub: string | null;
  contentLength: string | null;
}

export function runtimeInit(runtime: RuntimeExtensions) {
  runtime.addPlugin(
    new HydrolixRequestLoggerPlugin<LogEntry>({
      hostname: "your-hydrolix-hostname.com",
      username: "your-hydrolix-username",
      password: environment.HYDROLIX_PASSWORD,
      token: environment.HYDROLIX_TOKEN,
      table: "your-table.name",
      transform: "your-transform-name",
      batchPeriodSeconds: 0.1,
      generateLogEntry: (response: Response, request: ZuploRequest) => ({
        // You can customize the log entry here by adding new fields
        timestamp: new Date().toISOString(),
        url: request.url,
        method: request.method,
        status: response.status,
        statusText: response.statusText,
        sub: request.user?.sub ?? null,
        contentLength: request.headers.get("content-length"),
      }),
    }),
  );
}

Entries will be batched and sent as an array, they will be sent every batchPeriodSeconds. If not specified the will be dispatched very frequently (~every 10ms) to avoid data loss. Note that batchPeriodSeconds can be specified as a fraction, e.g. 0.1 for every 100ms.