Home > The Papertrail SaaS Add-On in DigitalOcean Centralizes Everything You Need for Log Management

The Papertrail SaaS Add-On in DigitalOcean Centralizes Everything You Need for Log Management

Centralizing Log Management blog post image
The SolarWinds® Papertrail software as a service (SaaS) Add-On in the DigitalOcean Marketplace is one of the most exciting developments to come out of the DigitalOcean and Papertrail partnership. With the Add-On, developers can seamlessly add the simple yet powerful log management Papertrail is known for to their DigitalOcean infrastructure. In an earlier post, we reviewed how the Add-On helps teams simplify their log management tasks. Here, we’ll look at how integrating Papertrail with DigitalOcean centralizes everything you need—dashboards, alerts, visualization—for log management.

All Your Logs on One Simple Platform

DigitalOcean makes it easy for developers to quickly spin up a wide range of compute, storage, and networking infrastructure. However, as developers build apps on this infrastructure, the amount of log messages generated adds up fast. Aggregating these logs in one place is the cornerstone of effective log management. But finding a platform capable of enabling log aggregation in a simple, robust, and affordable way isn’t easy. Many tools are either complex to configure and maintain, prohibitively expensive, or both. With the Papertrail SaaS Add-On, developers can configure logging in minutes. There’s no need to create a Papertrail account. Instead, you can simply select pick a plan, configure your Add-On’s details, and set up logging—all directly from your DigitalOcean portal. Install Papertrail Add-On page image From there, you can quickly begin aggregating logs from your DigitalOcean infrastructure. Because Papertrail supports most modern log sources—including Apache, NGINX, *nix systems, firewalls, and more—teams can consolidate all their logs in one place.

Customizable Log Dashboards

Customizable Papertrail dashboard image Of course, simply aggregating logs isn’t enough. Teams need to quickly and reliably capture insights from their log data. The Papertrail dashboard allows teams to create custom search groups to display what matters to them. The secret sauce behind the dashboards is the elegant search in Papertrail. Custom search terms allow you to create and save searches to build dashboards optimized for your infrastructure. For example, you can configure your dashboard to include custom searches for the following:
  • Error codes
  • Failed logins
  • Use of sudo
  • Logs from a specific app or service
  • Event severity
  • HTTP verbs
  • User agents
  • IP addresses
Additionally, traffic light filters make it easy to see what groups have recent activity. Papertrail dashboard traffic light filter image

Alerts, Reports, and Visualizations

In addition to the customizable dashboard, the Papertrail SaaS Add-On gives teams tools to extract insights and detect trends in log data.

Alerts

Papertrail alerts page image Papertrail alerts can send notifications to external services when a log message matches specific criteria. The alerts in Papertrail make it easy to ensure the right teams are notified of infrastructure events and help you avoid alert fatigue. You can define granular matching criteria in your search and send alerts at a frequency of your choosing. Papertrail create alerts page image With inactivity alerts, you can also know when something doesn’t happen. Inactivity alerts help infrastructure teams respond quickly to issues like failed cron jobs, backups that don’t run, and other scheduled tasks that fail. Papertrail inactivity alert page image

Log Velocity Graphs

Papertrail log velocity graph image When it comes to infrastructure, visibility context is key. In a vacuum, a single log message may be trivial. But in context, a spike in log messages can be an indicator of a service-impacting incident. Papertrail log velocity graphs let you visualize total log messages or log messages matching a specific search term (like sshd, sudo, error, root, or timeout). Additionally, log flood detection allows teams to receive an alert whenever log messages exceed a limit of a certain number of messages per second. Papertrail log flood detection image

Usage Reports and Log Archiving

The account usage reports in Papertrail make it simple to identify which sources are generating the most log data and plan for increases (or decreases) in log retention and storage. You can view your usage data directly from the Papertrail SaaS Add-On and export it as a CSV file for analysis. Papertrail account usage image Additionally, Papertrail keeps short-term archives of log messages you can manually download and export for review. For long-term storage, you can also send log archives to affordable S3 buckets. Papertrail log archive image You can also send log archives to Hadoop or Hive for long-term analysis. By adding Hadoop or Hive to the mix, you’ll have interactive SQL query access to your infrastructure log archives without significant additional complexity.

Fast Granular Drill-Down

The speed of root cause analysis is often the biggest hit on your mean time to recovery (MTTR). Papertrail allows you to quickly drill down from high-level searches and apply precise search filters to real-time log data. For example, you can run a live tail on your aggregated logs and filter for specific terms. Papertrail aggregated log filter In addition to powerful search syntax, you can further filter results with the Seek To feature, specifying a date and time range. Papertrail Seek to feature image You can even jump from points in the velocity graph to specific events in just a few clicks. Papertrail specific event on log velocity graph image Similarly, if you’re interested in a specific IP address, a single click can filter for all the available log messages with a matching IP. Papertrail IP address filter image The powerful yet simple approach Papertrail uses for log search lets you quickly answer the “who,” “what,” “when,” and “how many times” questions vital to incident response. This approach is especially useful in a complex microservices architecture. For example, you can use a trace ID to search across logs from multiple sources to debug an issue across multiple services.

Do More and See More—In One Place

Developers choose DigitalOcean because it enables them to build more with less complexity. The Papertrail SaaS Add-On for DigitalOcean applies this same simple philosophy to log management. With the Add-On, teams get powerful log management capable of increasing visibility across their infrastructure without the configuration complexity and tool sprawl associated with other solutions. As a result, teams can build more and see more—all in one place—with less time and effort. Want to try the Add-On for yourself? You can get started for free by using the Papertrail Add-On in the DigitalOcean Marketplace.
Melanie Achard
Melanie Achard is a director of product marketing at SolarWinds. Achard’s career in technology started out as favor to a friend when she wrote her…
Read more

Tweets

SolarWinds's Twitter avatar
SolarWinds
@solarwinds

Check out the essential guide to digital transformation on @itbriefasia: t.co/ZAPC0qLXAg

SolarWinds's Twitter avatar
SolarWinds
@solarwinds

Webhooks can collect real-time data in a more productive way than API polling. Learn more about webhook utilization… t.co/kXUogA7OQ1

SolarWinds's Twitter avatar
SolarWinds
@solarwinds

@SQLEspresso It looked like a great time! 🎤