Update: Microsoft will be moving away from UserVoice sites on a product-by-product basis throughout the 2021 calendar year. We will leverage 1st party solutions for customer feedback. Learn more here.

Event Hubs

Azure Event Hubs is a hyper-scale data ingestion service, fully-managed by Microsoft, that enables you to collect, store and process trillions of events from websites, apps, IoT devices, and any stream of data.

  1. Allow more than 10 hubs per event hub namespace

    Event hub namespaces have a hard limit of 10 hubs. It would be great to be able to raise that limit to 100 or 1000 or whatever via a support request.

    We use Azure Event Hubs with Kafka. A namespace for us is a kafka server and a hub is a kafka topic. Now we have to split topics per kafka server based on Azure's 10 hubs hard limit, which is counterintuitive and complicates our setup.

    160 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    10 comments  ·  Flag idea as inappropriate…  ·  Admin →
  2. emulator

    An Azure Event Hub emulator (preferably in a container) to do local testing

    107 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    6 comments  ·  Flag idea as inappropriate…  ·  Admin →
  3. Using a filter with EventHub data

    Will we be able to use a filter in the future for the EventHub data? I'm designing a new solution for a customer and it looks like EventHubs are great for sending and receiving our near-realtime data. Downside is when receiving the data, we receive all data of all our devices in the world. Most of the time, our clients only want to see data of one (or a few) device. We could of course filter the data by ourselves, client side, but this would cost a lot of bandwith.

    51 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    10 comments  ·  Flag idea as inappropriate…  ·  Admin →
  4. Allow Secondary EventHub's tags to be updated via ARM/PS/Policies

    When setting up Azure policy for tag inheritance, you cannot exclude secondary namespaces, even though by definition the secondary namespaces cannot be updated under any circumstances. So when you do an automated deployment the policy kicks in and deployment fails wit the error "Cannot update a namespace that is secondary".

    The only suggested way to get around this from Microsoft is to break the pairing (10 minutes) delete secondary namespace's event hubs (2-5 minutes) and set up tags enable pairing gain (10 minutes). I am setting this as the baseline, and it turns out it will be at least 25…

    44 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  5. Data Lake Gen2 Capture Support

    Currently you can capture to Data Lake Gen1 or Blob but not Data Lake Gen 2. Sad times.

    36 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  6. Docker image for Event Hub in local/dev/test environments

    A container that acts like an event hub so that in local/dev/test/ci environments it's easy to spin up and tear down application stacks that are dependent on event hub.

    34 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  7. Remove the EventHub Message Size limit of 1MB

    Currently we have a size limit on the incoming messages on an EventHub as 1MB. Some processes batch the messages before sending them, to avoid making several POST requests. Even though the batch size is small as 10, the size is unpredictable when the message is sent, as it hits the 1MB mark. Please could we remove the size limit or at least increase the limit form 1MB to 5MB/10MB?

    Kafka does not have a size limit. Google has a limit of 10MB.

    33 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  8. I want to see number of outgoing messages by consumer group

    I can load up graphs showing outgoing messages by the event hub, but I want to see more granularly down to outgoing messages by the consumer group.

    32 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  9. Provide Event Hub viewer / explorer

    It would be good if some sort of viewer/explore was provided for looking at the events within an Event Hub. This could be done either via the portal or Azure Storage Explorer.

    When developing I currently use https://marketplace.visualstudio.com/items?itemName=Summer.azure-event-hub-explorer to view events as they are produced.

    However, it would be good if a tool existed that let you browse events within the retention period. With the possibility to query by timestamp & partition key. As well as the event body, it would be good to be able to see the properties and other metadata.

    We use Event Hub as the integration…

    31 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  10. Built-in Capture feature of Event Hub should preserve milliseconds in EnqueuedTimeUTC system property

    When activating the built-in capture feature in Event Hub, messages are stored in Blobs using AVRO format. In AVRO, system prop EnqueuedTimeUTC is serialized as a string, and the odd part is that milliseconds are not there. Basically, capture feature is truncating the original information, which it should not do

    16 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  11. Event Hub Encryption

    Provide the ability to have Event Hub do a behind the scenes encryption. Something similar to Azure SQL TDE where we can check a box and the Event Hub is encrypted at rest.

    16 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  12. Please provide message and events replication for disaster recovery in the Event hub .Currently It supports metadata replication only.

    Please provide message and events replication for disaster recovery in the Event hub .Currently It supports metadata replication only.We have to poll stuck messages from old primary event hub.Event hub Disaster recovery involves manual steps .Please provide feature to replicated the messages also .So that this process become automatic.

    12 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    3 comments  ·  Flag idea as inappropriate…  ·  Admin →
  13. Add an automatic scale down to better handle fluctuating workloads.

    The current auto-inflate feature is great to handle gradual increase in workload without downtime. For peak loads, however, it means billing is done on the highest throughput of a given period if no action is taken. This is detrimental to a number of use-cases.

    12 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  14. Identify producer

    We are using Azure.Messaging.EventHubs to produce events at various apps and consume them in other app.

    We primarily use AAD to authenticate against Event Hubs despite there are other authentication schemas.

    Now because there are multiple producers, we would like to verify the authenticity of the producer. This cannot be achieved by adding additional property to event (properties) by producers itself as there is no authority guaranteeing its authenticity.

    Because AAD authentication validation happens server side and is the only authority, we would like the EventHub service to fill SystemProperties server side with App Id / Tenant Id or other…

    9 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  15. Allow Event Capture to output in different file formats

    Currently event capture only supports writing in avro. It would be nice to support other file formats for processing e.g JSON and parquet.

    9 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  16. Kafka Streaming connection with Event Hub

    In trying to be more efficient with read/writes into CosmosDB my customer is requesting that having a Kafka Stream connect to Event Hub directly will provide some signficant savings. Also Kafka is very commonly used for Streaming across various enterprises and so hopefully supporting this connectivity for Event Hub might mean a good thing.

    Some more details with an example below, there are workarounds I am sure but hope this helps:

    o We currently have several read services and several write services. With Kafka Streaming the reads are consolidated in a Kafka queue and published to Event Hub as a…

    9 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    2 comments  ·  Flag idea as inappropriate…  ·  Admin →
  17. Diagnostics Logging should also log successful/unsuccessful authentication/authorization requests

    Same as in Azure Search, Cosmos DB and other components, diagnostics logging should also log 401/403 errors when e.g. trying to access Event Hubs with a wrong Token/Key.

    This is important for security reasons to setup e.g. Alerting in Log Analytics to monitor "unsuccessfull authentication/authorization" attempts

    8 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  18. Make Event Hub Capture Flexible

    Right now event hub capture if very limited in terms of configuration. Making the following configurable would improve many use cases:

    • Format: Allow the user to select the capture format. Avro as a default is not widely supported (e.g. in Data Analytics)

    • Save Path: The event hub partition id is not a functional key, but the partition key is. Allowing the captured events to be saved to a path including the partition key (as opposed to the partition id) improves many query scenarios (query items in a partition). It would also help to be able to control the granularity of…

    8 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
  19. Need to monitor throughput, incoming/outcoming message on individual Event Hub instead of Event Hubs Name Space

    Need to monitor throughput, incoming/outcoming message on individual Event Hub instead of Event Hubs Name Space

    7 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    1 comment  ·  Flag idea as inappropriate…  ·  Admin →
  20. Make IEventProcessor implemented classes unit tests friendly.

    PartitionContext that is passed to "ProcessEventsAsync" method of Microsoft.ServiceBus.Messaging.IEventProcessor implicitly relies on checkpoint manager instance. So, call to "CheckpointAsync" method throw NullReferenceException in context of unit tests.
    That is the only thing from writing unit-tests friendly code without increasing complexity of class structure.

    7 votes

    We're glad you're here

    Please sign in to leave feedback

    Signed in as (Sign out)

    We’ll send you updates on this idea

    0 comments  ·  Flag idea as inappropriate…  ·  Admin →
← Previous 1 3
  • Don't see your idea?

Event Hubs

Categories

Feedback and Knowledge Base