So it turns out, this is not solved. It only was solved for a short amount of time, than it came back. It is definitely connected to this bug report: https://forum.bricksbuilder.io/t/wip-builder-lags-and-massive-cpu-spikes-when-working-with-dynamic-data/