Calibre vs OpenPanel

The August release brings deployments into Real User Monitoring: deploy markers run along the bottom of charts, hovering one reveals the commit, author, and time, and clicking through opens the commit in source control, with each deployment compared against the previous. The same day, Synthetic metrics moved from one page at a time to median aggregates across all pages, segmented by test profile, deployment, and page — so a regression can be identified as site-wide or isolated. Before that: automatic measurement of soft navigations in single-page apps, a site-scan crawler that discovers and maintains the monitored page list on its own, self-service SAML SSO with SCIM on the Team plan, and an organisation-wide audit log that exports as NDJSON or streams to a SIEM over signed webhooks.

Calibre is closing the loop between a metric moving and someone knowing why. Deployment attribution supplies the cause, the all-pages segmentation supplies the scope, and soft-navigation measurement fills the blind spot that made SPA numbers untrustworthy in the first place. Running alongside that is a distinctly enterprise track — SSO, SCIM, and an audit log with SIEM streaming are procurement requirements, and putting SAML on the Team plan rather than reserving it for Company is a deliberate move down-market with them.

Expect deployment attribution to grow into alerting — a regression tied to a specific commit is the natural trigger for a notification, and the pieces are now all in place. How far the site-scan crawler is meant to replace manual page management is not yet clear from these entries.