Stay up to date on system status by streaming Azure Diagnostic Logs to Event Hubs

Michael Cottuli

If you’re using Azure, there’s a good chance you’re a big fan of its new and efficient ways to read data. Azure Diagnostic Logs, which provide insight into the operation of resources, are now going to be able to be streamed through Event Hubs. Up until now, you were only able to store Azure Diagnostic Logs in your storage account, but the addition of Event Hubs support gives users a lot more in the way of options.

Here’s what the change allows you to do, according to Microsoft’s Azure blog post:

  • Stream logs to 3rd party logging and telemetry systems – Over time, Event Hubs streaming will become the mechanism to pipe your Diagnostic Logs into 3rd party SIEMs and log analytics solutions.
  • View service health by streaming “hot path” data to PowerBI – Using Event Hubs, Stream Analytics, and PowerBI, you can easily transform your diagnostics data into near real-time insights on your Azure services.
  • Build a custom telemetry and logging platform – If you already have a custom-built telemetry platform or are just thinking about building one, the highly scalable publish-subscribe nature of Event Hubs allows you to flexibly ingest diagnostic logs.

This isn’t a major change, but it frees up some options for people who consider themselves data hounds. Event Hubs is a service that’s already constantly streaming information to its user, so adding the data from Azure Diagnostic Logs just makes sense. If you want to learn a little bit more about what Event Hubs has to offer, you can check out its official site here.