This was happening for me consistently in Firefox; the main thread would get further and further behind on processing messages from the worklet, as it caused a React rerender for every single message.
Now it just rerenders once per animation frame, using the latest data received from the worklet.