graph panning resets view

[Nasimovy]

Checklist

• I have updated to the latest available Home Assistant version.
• I have cleared the cache of my browser.
• I have tried a different browser to see if it is related to my browser.
• I have tried reproducing the issue in safe mode to rule out problems with unsupported custom resources.

Describe the issue you are experiencing

graph panning view resets after zooming in and scrolling to the oldest data

2024-12-25_21-21-18.mp4

(i first thought you had to have more then one sensor to trigger it but that doesn't seem make a difference )

Describe the behavior you expected

zoom level stays the same

Steps to reproduce the issue

1. go to history
2. select a sensor (temperature
3. zoom in
4. scroll/pan to the oldest data
5. issue as described

What version of Home Assistant Core has the issue?

2025.1.0b2

What was the last working version of Home Assistant Core?

No response

In which browser are you experiencing the issue with?

Google Chrome Version 131.0.6778.205 (Official Build) (64-bit)

Which operating system are you using to run this browser?

W11

State of relevant entities

No response

Problem-relevant frontend configuration

No response

Javascript errors shown in your browser console/inspector

No response

Additional information

No response

[MindFreeze]

The existing PR fixes this as well