Stream Heroku Logs into Google BigQuery

Stream Heroku Logs into Google BigQuery

Instantly connect Google BigQuery to your Heroku logs. Google BigQuery makes storing and exploring log data easier than ever - it's the easiest way to stream and query your Heroku logs.

Streaming logs from Heroku to BigQuery is the only thing BigQuery Log Drain does.

Sure, there are a lot of services out there that offer to help solve this problem for you. They also attempt to solve other problems too - leaving you to deal with complexity and high prices! That is unacceptable. BigQuery Log Drain is laser-focused on this single problem - streaming Heroku logs into BigQuery.

BigQuery Log Drain offers a simple solution - with simple pricing - to a common problem.

Up-and-Running in Minutes

Start streaming your Heroku logs into your BigQuery tables in less than 10 minutes*.

  • Create a drain

    Use the BigQuery Log Drain app to create a new drain. A unique drain name and an initial drain sender will be created automatically.

  • Define the BigQuery drain table

    Provide the BigQuery Project ID, Dataset ID, and Table ID - this is where log event data will be streamed.

  • Upload Google Credentials JSON

    Use the Google Cloud Console to download Google Credentials JSON then upload to BigQuery Log Drain app. The Google Credentials need to be associated with a service account with sufficient permissions to insert records.

  • Add drain to Heroku app

    Use the Heroku CLI to add the drain to your Heroku app using the preformatted drain URL: https://{username}:{password}@logdra.in/{drain.id}/logs

    $ heroku drains:add {drain url} -a your-heroku-app-name
  • Start querying!

    Within minutes your BigQuery table will begin populating as Heroku logs stream in.

Healthy Relationship Included

For no additional charge you'll automatically benefit from commitments to create and maintain a healthy relationship built on trust, respect, and privacy.

BigQuery Log Drain will not store your logs

We will not store your logs. Ever.

Your privacy and data security is important - so important that you can rest easy knowing the contents of your logs will never be stored by BigQuery Log Drain and that every transmission of your logs is handled safely and securely. No protected classes of information (like PII and PHI) from your logs will be stored.

BigQuery Log Drain will store network metadata about your logs to monitor usage and provide reporting to you.
BigQuery Log Drain will not sell to you

We will not attempt to upsell you. Ever.

Your inbox will not be crowded with unsolicited, aggressive, or desperate sales emails from BigQuery Log Drain. You will only be emailed when concrete action is required on your part to setup or maintain your account. No CRMs. No sales people. No "check-ins." No "quick calls."

Joining the waitlist will produce at most four distinct emails: double opt-in request, double opt-in confirmation, new referral confirmation, and invitation to signup.

Let's Talk Pricing

BigQuery Log Drain's goal is to provide a simple solution that streams your Heroku logs into your BigQuery tables. A simple pricing plan is part of that solution. You shouldn't need a spreadsheet and formulas to project your expenses - BigQuery Log Drain's pricing plan was designed with that top of mind.

Your first drain is only $39/mo
Every drain includes:
  • Unlimited senders
  • 1M daily log events
  • Senders

    A sender is a unique, arbitrary username and password combination that can be associated with a drain.

    If you have more than one app targeting one drain, senders help to control access to the drain.
  • Log Events

    A log event is a single log line that results in a single BigQuery record.

    Heroku's Logplex system sends logs to drains in batches of one or more log lines. BigQuery Log Drain doesn't care how many batches BigQuery Log Drain receives; BigQuery Log Drain cares how many events it processes for you.

Grow at Your Own Pace

Your business is going to grow. Your apps are going to grow. That means your logs are going to grow and our pricing plan is designed to grow with you.

Additional drains $19/mo per drain
Daily log event overages (optional) $19 per 1M block of daily log events By default this option is not enabled. If disabled, the billing remains dead simple and your log drain will no longer process log events for the day after the daily quota has been reached. If enabled, the billing does get a little more complicated to keep your logs flowing. This overage expense is under your control.

Don't waste any more time on this trivial problem.

This problem, while common and mildly frustating, is likely not the biggest thing on your plate. You could be streaming your Heroku logs into your BigQuery tables by now.