Compare two models

Both models on the same 30 PRs and review mode, with the bugs each one found and missed.

The generalist plus 9 specialist lens agents in parallel, then the same verify and dedup steps.

46.4F240.6
44.3F134.4
47.9%Recall46.3%
41.1%Precision27.3%
141Comments205
$1.296Cost / PR$2.072
$0.670Cost / bug$1.110
43both found
15only DeepSeek V4 Pro
13only Muse Spark 1.2
50neither found

Per-PR diff (30)

Keycloak · Javaadd-caching-support-for-identityproviderstorageprovider-getforlogin-operations-keycloak
1 disagree · 2 gold bugs
lowThe test registers cleanup for the literal alias "alias" instead of the created IDP aliases, so the created identity providers are never cleaned up.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
highAdding the organization/BROKER_PUBLIC check to the shared LoginFilter.getLoginPredicate also changes IdentityProviderBean.federatedProviderPredicate, so with organizations disabled a user's linked IdP that has an organizationId but is not public is no longer shown on the login page.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Keycloak · Javaadd-client-resource-type-and-scopes-to-authorization-schema-keycloak
2 disagree · 8 gold bugs
mediumClaims the removal-cleanup listener is guarded by the V1 fine-grained flag, so client/role/group permissions are orphaned when V1 is disabled or only V2 is enabled.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highgetClientsWithPermission in ClientPermissionsV2 only finds the type-level 'Clients' resource and returns its name, never actual client ids, so callers that resolve the returned values as client ids get wrong results or null clients.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumClaims getResourceTypeResource can return null in ClientPermissionsV2.hasPermission, causing a NullPointerException in findByResource.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumClientPermissionsV2.canView() ignores a global MANAGE permission, so admins with only global manage take the unpaginated, per-client evaluated listing path.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highcanView(client) short-circuits on the global all-clients VIEW permission, so a client-specific permission denying an admin is never evaluated and the client is still viewable.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumThe negative check for removing a default client scope expects ForbiddenException, but it can come from the preceding getDefaultClientScopes() call, so the test passes even without a permission check on removal.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
highIn ClientPermissionsV2.hasPermission, an admin granted a permission on all clients is denied on any client that also has its own per-client permission resource, because only the per-client resource is evaluated.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
highClientPermissionsV2.canExchangeTo throws UnsupportedOperationException, but AbstractTokenExchangeProvider still calls clients().canExchangeTo for client-to-client exchange, so with token exchange and FGAP V2 enabled the request fails with a server error instead of a permission decision.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
cal.com · TypeScriptadd-guest-management-functionality-to-existing-bookings-cal-com
2 disagree · 8 gold bugs
highisTeamAdminOrOwner combines isTeamAdmin and isTeamOwner with &&, so only team owners pass; team admins who are not organizer or attendee are wrongly rejected with FORBIDDEN.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe guest blacklist is lowercased but incoming guest emails are compared without normalization, so a blacklisted address submitted with different casing bypasses BLACKLISTED_GUEST_EMAILS and is added and emailed.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe server never deduplicates the guests array, so a request with the same email twice inserts duplicate attendee rows for the booking.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe handler passes the unfiltered guests list to sendAddGuestsEmails, which uses it to pick who gets AttendeeScheduledEmail, so existing attendees included in the request receive a new-booking confirmation instead of the add-guests email.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highEventManager is created with the requesting user's credentials, so when a non-organizer adds guests the organizer's calendar event is not updated (or the wrong account is used) for references without a credentialId.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
mediumsendAddGuestsEmails ignores the event type's disableStandardEmails settings, so hosts and attendees receive add-guests emails even when standard emails are disabled.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
mediumThe add-guests handler omits booking.iCalUID from the CalendarEvent, so the add-guests emails' .ics attachments use booking.uid as UID and recipients' calendars treat them as a new event rather than an update of the original booking invite.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highGuest email uniqueness is checked case-sensitively, so case variants of the same address are accepted as distinct guests (and slip past the lowercased blacklist).DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Keycloak · Javaadd-html-sanitizer-for-translated-message-resources-keycloak
1 disagree · 2 gold bugs
mediumThe diff-trimming code computes common prefix and suffix independently, so they can overlap and substring throws StringIndexOutOfBoundsException, crashing the verifier instead of reporting the illegal HTML.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
mediumThe account and admin UI bundles now use Java MessageFormat placeholders and choice syntax for error-invalid-multivalued-size, but i18next expects {{n}}, so the UI shows literal {0}/{1}/{2} and the raw choice text.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
Grafana · Goanonymous-add-configurable-device-limit-grafana-codex
agree · 2 gold bugs
hightagDeviceUI caches the device key before CreateOrUpdateDevice; when the store returns ErrDeviceLimitReached the entry stays, so the next request from the same device skips the limit check and authenticates for up to 29 minutes.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe new auth.anonymous device_limit setting has no entry in conf/defaults.ini, so the GF_AUTH_ANONYMOUS_DEVICE_LIMIT environment override is ignored and the limit stays 0.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Grafana · Godual-storage-architecture-grafana-codex
agree · 9 gold bugs
mediumThe legacy DeleteCollection goroutine records its duration with recordStorageDuration instead of recordLegacyDuration, misattributing legacy latency and errors to the storage metric.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumDelete's success path records the storage metric with the object name in the kind label instead of options.Kind, creating per-object series and inconsistent labels.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumOn storage Create/Update failure the duration is recorded with recordLegacyDuration, attributing unified-store errors to the legacy metric.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highMode 3 legacy writes now run in background goroutines derived from the request context, which is cancelled when the request completes, so legacy writes can be cancelled and legacy storage falls out of sync.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highLegacy.Update now receives the original objInfo instead of a wrapper carrying the object stored in unified storage, so legacy recomputes the update and can diverge.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe Mode 3 tests never wait for or assert the asynchronous legacy writes, and legacy and storage share one mock, so removing the legacy calls would not fail them.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highIndependent per-request goroutines remove ordering between legacy writes to the same resource, so legacy can end up with an older version or a resurrected object.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumMode 3 legacy-storage write errors (create/update/delete/delete-collection) are no longer logged after moving to async goroutines; only a duration metric with an error flag is recorded.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highDualWriterMode3.Delete now returns on any unified-storage error, including NotFound, before deleting from legacy, so objects that exist only in legacy can no longer be deleted.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Discourse · Rubyenhance-embed-url-handling-and-validation-system-discourse-cursor
1 disagree · 12 gold bugs
highThe referer and embed_url host checks compare against SiteSetting.embeddable_host case-sensitively, so a host differing only in case is rejected even though hostnames are case-insensitive.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highPollFeed reads i.content.scrub for every feed item, so items without a content element (common in RSS feeds that only have description) raise NoMethodError and abort the import of the remaining items.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
criticalTopicEmbed.import appends a footer that interpolates the URL unescaped into an <a href='...'> tag in raw HTML that is later rendered unsanitized, so a crafted URL can inject markup; it also appends to contents with << without handling nil.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highWhen the embedded post has been deleted, TopicEmbed.import's update path passes a nil embed.post to PostRevisor and crashes on every later import of that URL.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
mediumClaims import_remote crashes on unparseable pages (nil content) and dead URLs because it does no nil check or network error handling around open(url).read.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumabsolutize_urls only handles root-relative paths: protocol-relative URLs like //cdn.example.com/x.png are rewritten to http://host/cdn.example.com/x.png and path-relative links are left unresolved, breaking links and images in imported posts.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumEvery retrieval of an article not yet embedded synchronously polls and imports the entire RSS feed, and since throttling is per URL, many different article requests repeat the full feed download and processing.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumThe 'requires feed_polling_url' and 'requires embed_by_username' specs leave feed_polling_enabled at its false default, so they never reach the condition they name and would pass with those checks deleted.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
high`import_remote` fetches the embed URL with open-uri, which follows redirects, so the embeddable-host check on the initial URL can be bypassed to reach internal services (SSRF).DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumThe retrieve throttle is keyed by the full embed URL, so an anonymous client can vary the query string on the embeddable host to bypass it and make the server create an unbounded number of topics.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumThe "requires feed_polling_enabled?" spec leaves feed_polling_url and embed_by_username at their blank defaults, so poll_feed is skipped regardless and the test would pass even without the enabled check.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highThe embed layout references the 'embed' stylesheet and embed.js, but neither is in config.assets.precompile, so with precompiled assets in production the embed page fails to load them.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
cal.com · TypeScriptfeat-2fa-backup-codes-cal-com
agree · 1 gold bugs
criticalThe credentials authorize() skips the password check when any totpCode is present, and the new backup-code branch never validates that totpCode, so a backup code plus a dummy totpCode logs in without the account password.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
cal.com · TypeScriptfeat-convert-insightsbookingservice-to-use-prisma-sql-raw-queries-cal-com
1 disagree · 3 gold bugs
mediumThe getBaseConditions test uses a single booking matching both auth and filter conditions, so it would pass even if the conditions were not combined.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
mediumThe new public options type makes teamId optional for team scope, so a missing teamId compiles and silently yields empty insights instead of a type error.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highClaims getBaseConditions returns OR fragments without parentheses, so a caller appending `AND <extra>` would leak rows outside the authorization scope.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Sentry · Pythonfeat-ecosystem-implement-cross-system-issue-synchronization-sentry
agree · 0 gold bugs

No gold bugs in this PR.

Sentry · Pythonfeat-workflow-engine-add-in-hook-for-producing-occurrences-from-the-stateful-det-sentry
agree · 2 gold bugs
highMetricAlertDetectorHandler subclasses StatefulDetectorHandler without implementing its abstract methods, so instantiating it for metric alert detectors raises TypeError where it previously returned an empty-result handler.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe mock occurrence builder ignores its value argument, so tests (e.g. group_2 expected with 6 while the packet carries 10) pass regardless of which value is passed to build_occurrence_and_event_data.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
Discourse · Rubyfeature-automatically-downsize-large-images-discourse-cursor
3 disagree · 8 gold bugs
highdownsize is defined twice in OptimizedImage; the new (from, to, dimensions, opts) version overrides the (max_width, max_height) one, so existing callers such as ResizeEmoji that pass width and height now raise ArgumentError.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe client-side upload size check hardcodes 10 MB instead of the per-type max_<type>_size_kb setting, so attachment limits diverge from the server: larger allowed attachments are blocked and smaller limits are only enforced server-side.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe upload downsizing passes a percentage ('80%') as dimensions, but for animated GIFs the gifsicle path uses --resize-fit, which expects WxH geometry, so downsizing silently fails.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
mediumAuto-downsizing passes the upload tempfile path, which lacks a .gif extension, so the animated branch is never chosen and convert keeps only the first frame, flattening oversized animated GIFs.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
highClaims the downsize loop checking tempfile.size may never terminate because of a stale cached size, causing infinite loops.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highOversized SVG uploads go through the new ImageMagick downsize loop because SVG counts as an image, so the vector file is rasterized or corrupted in place before Upload.create_for parses it as SVG.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
criticalThe upload tempfile path, which for API URL uploads embeds the request-controlled type param, is now passed to OptimizedImage.downsize and run unescaped in a shell via backticks, allowing command injection through type.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumThe 413 upload error message states a hard-coded 10 MB maximum that may not match the limit the server or web server actually enforces.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Discourse · Rubyfeature-can-edit-category-host-relationships-for-embedding-discourse-cursor
agree · 4 gold bugs
highThe migration reads execute(...)[0]['id'] for embed_category without checking for an empty result, so installs without that setting stored crash the migration instead of falling back to the uncategorized category.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumAfter saving a host, the component overwrites its category with findById(categoryId); when no category was chosen this is null even though the server saved the uncategorized category, so the row shows no category until reload.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highHosts saved with a port (allowed by the validation regex) are stored as host:port, but lookup compares only URI.host, so those configured hosts never match and embedding fails for them.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highEmbeddableHost's host format validation only accepts TLDs of 2-5 letters, so admins cannot add embeddable hosts on longer TLDs like example.technology.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Discourse · Rubyfeature-localization-fallbacks-server-side-discourse-cursor
agree · 2 gold bugs
mediumFallback locale catalogs are only loaded in the controller's set_locale filter, while translate loads just the current locale, so translations outside requests (jobs, mailers) cannot fall back to the site default or English.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe translation cache key does not include the site or its default locale, but fallback results now depend on SiteSetting.default_locale, so multisite processes or a changed default locale serve stale fallback translations.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Keycloak · Javafix-concurrent-group-access-to-prevent-nullpointerexception-keycloak
agree · 0 gold bugs

No gold bugs in this PR.

cal.com · TypeScriptfix-handle-collective-multiple-host-on-destinationcalendar-cal-com
3 disagree · 9 gold bugs
highWhen externalCalendarId is absent, updateEvent/deleteEvent look for a destination calendar whose externalId equals that absent value, so the lookup never matches and the configured destination calendar is no longer used.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe organization slug is now set only when team billing is enabled (inverted condition), so with billing both slug and requestedSlug are set and without billing neither is.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highOffice365 (and Lark) createEvent ignore the new credentialId argument and always use the first destination calendar, so in collective bookings other hosts' credentials target the organizer's calendar instead of their own.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
highThe Google Meet fallback reads mainHostDestinationCalendar.integration without optional chaining, so a Meet booking with a null or empty destinationCalendar throws instead of falling back to Cal Video.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highFor collective events whose organizer has no destination calendar, destinationCalendar is null and the optional push drops all other hosts' destination calendars, so those hosts never get calendar events.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highVideo booking references are now saved without their credentialId, so cancelling the booking can no longer find the video credential and the meeting is not deleted.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
highCancelling all remaining occurrences of a recurring collective booking deletes only the first calendar reference of each booking, repeated once per host, so the other hosts' events stay on their calendars.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumIn Google createEvent, when no destination calendar matches the credentialId, the hangout-link events.patch is called with an undefined calendarId and fails, so the Meet link is not added to the event description.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumWhen cancelling a recurring booking with multiple calendar references, the recurring-event deletion over all remaining bookings and credentials runs once per reference, causing duplicate delete calls and errors.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
Discourse · Rubyfix-proper-handling-of-group-memberships-discourse-cursor
4 disagree · 10 gold bugs
mediumThe admin group pager computes total pages as floor(user_count / limit) + 1, so when the member count is an exact multiple of the limit it shows an extra page and Next navigates to an empty member list.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumPaging actions fire overlapping member requests and each response unconditionally overwrites offset and members, so a stale response arriving last can revert the list to an earlier page.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highThe public members endpoint now always caps results at 50 per page, but the public group members page has no pagination, so groups with more than 50 members are silently truncated for users.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
mediumCreating a group ignores the alias_level the admin selected, saving only name and visibility, so new groups keep the default alias level.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumRemoving a member deletes the membership row directly and skips clearing the user's primary_group_id, so a removed user can keep this group as their primary group.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumGroup member pagination is off by one when user_count is a multiple of limit: Next moves to offset == user_count and shows an empty page.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
mediumAdmin remove_member deletes memberships with group.users.delete, which skips GroupUser callbacks, so the cached groups.user_count is never decremented and stays inflated.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumAdmin add_members pushes every username into group.users without skipping existing members, so adding someone already in the group hits the unique group_users index, returns a 500 and leaves earlier users partially added.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
mediumThe public group members endpoint takes `limit` from params with no upper bound or positivity check, letting a visitor request huge pages or trigger a 500 with a negative limit.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
mediumAdmin remove_member calls group.users.delete with a raw integer id, which raises RecordNotFound (404/500) when the user is not or no longer a member, e.g. on concurrent removal.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Keycloak · Javafixing-re-authentication-with-passkeys-keycloak
agree · 0 gold bugs

No gold bugs in this PR.

Grafana · Gofrontend-asset-optimization-grafana-codex
agree · 0 gold bugs

No gold bugs in this PR.

Sentry · Pythongithub-oauth-security-enhancement-sentry
agree · 1 gold bugs
mediumtest_installation_not_found uses a wrong OAuth state, so it fails at the state check and never reaches the installation-not-found path it is meant to test.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
Keycloak · Javaimplement-access-token-context-encoding-framework-keycloak
agree · 0 gold bugs

No gold bugs in this PR.

Grafana · Gonotification-rule-processing-engine-grafana-codex
2 disagree · 4 gold bugs
highThe pause menu item is still gated on a Grafana ruler rule, but the list view now passes only the Prometheus rule, so Pause/Resume disappears for list-view rules even when the user may pause them.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
highThe Delete menu item still requires a ruler rule, which list-view Grafana rules no longer provide, so users with delete permission lose the Delete action.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
mediumWhen the Grafana prom-rule branch is skipped (datasource rules), useAllGrafanaPromRuleAbilities(undefined) still reports Duplicate as supported and allowed by Grafana create permission, and AlertRuleMenu ORs it with the ruler ability, so Duplicate appears on cloud rules even when the ruler check denies it.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highFor list-view Grafana rules RuleActionsButtons gets only promRule, so the Silence menu item is shown but the silence drawer, still gated on a ruler alerting rule, never renders and clicking Silence does nothing.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
cal.com · TypeScriptoauth-credential-sync-and-app-integration-enhancements-cal-com
3 disagree · 9 gold bugs
mediumThe webhook parses the body with zod .parse and decrypts/JSON-parses the keys without error handling, so invalid payloads produce 500 errors instead of 400 responses.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
highparseRefreshTokenResponse writes the hardcoded string 'refresh_token' when the refresh response omits a refresh token, so the stored credential gets an invalid refresh token and later refreshes fail.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumminimumTokenResponseSchema uses computed keys from z.string().toString(), which produce a literal key rather than a wildcard, so the sync-mode schema does not validate or keep expiry and other token fields as intended.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highGoogle Calendar persists the safeParse result object instead of its data as the credential key, corrupting the stored credential so later reads fail.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumSalesforce getClient now refreshes the OAuth token and writes the credential on every service construction, adding a network round trip and DB write even when the access token is valid.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
highThe new Salesforce token refresh uses prisma without importing it, so the code fails type checking and throws a ReferenceError at runtime.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
highSalesforce checks response.statusText !== 'OK' instead of response.ok when refreshing the token, which can misclassify successful responses, and then ignores the refreshed token.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highAfter refreshing the Salesforce token, jsforce.Connection is created with the stale access_token and instance_url instead of the newly refreshed values.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe app-credential webhook looks up appStoreMetadata by app.slug, but the map is keyed by dirName, so apps whose slug differs from their directory (e.g. google-calendar) always get a 404 and their credentials cannot be synced.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Discourse · Rubyoptimize-header-layout-performance-with-flexbox-mixins-discourse-cursor
agree · 5 gold bugs
mediumThe flex-item styles target the inner .extra-info-wrapper instead of the component's root div, so in the flexbox header a long topic title keeps its full width and pushes the navigation panel out instead of being truncated.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
lowThe align-items mixin emits no -moz-box-align, so on old Firefox versions using the display:-moz-box fallback the advertised vertical centering is not applied.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
lowRemoving the float-based right alignment of .d-header .panel leaves the server-rendered (no-JS) header's login panel, which sits inside .row and is not a flex item, no longer right-aligned next to the title.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
lowMaking .small-action a flex container leaves .small-action-desc content-sized (no flex:1), so the right-floated edit/delete buttons inside it sit right after short action descriptions instead of at the right edge of the row.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumOn mobile the .small-action custom message keeps margin-left:-40px, tuned for the old 4em left padding; with the new flex layout and 1.5% padding it is pulled into the avatar column and overlaps the icon.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
Grafana · Goplugins-chore-renamed-instrumentation-middleware-to-metrics-middleware-grafana-codex
agree · 0 gold bugs

No gold bugs in this PR.

Sentry · Pythonref-crons-reorganize-incident-creation-issue-occurrence-logic-sentry
agree · 0 gold bugs

No gold bugs in this PR.

Sentry · Pythonreplays-self-serve-bulk-delete-system-sentry
1 disagree · 10 gold bugs
mediumThe age/timestamp mutual-exclusion validators check truthiness via initial_data.get(), so a zero value is treated as absent and a report carrying both fields passes validation.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe validation-failure warning logs the entire raw, attacker-controlled browser report instead of a redacted subset.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
mediumThe Snuba replay lookup for error IDs runs even when enable_error_context=false, adding a needless query (and failure point) to opt-out requests.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highWith the use-table-widget-visualization flag on, the widget renders TableWidgetVisualization with hardcoded empty columns and data instead of the query results, so every table widget shows an empty table.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe custom cell renderers fall back to default rendering on any falsy return (0, '', null), not only undefined, so a renderer cannot render zero or an empty cell.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumThe attribute-keys query key no longer includes the organization slug, so two organizations with the same filters share a cache entry and switching orgs can show the previous org's attribute names.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumEvery paginated breadcrumb-summary request queries the replay and fetches all of its error events from nodestore with no cap, adding latency and memory proportional to the replay's error count on each page.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumHIDDEN_ATTRIBUTES is applied only when a search query is present; the no-search early return shows all attributes, so the hidden attributes still appear in the default span attributes view.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumThe bulk delete test sets max_segment_id to None to cover the new guard in _make_recording_filenames, but it mocks delete_matched_rows, so the guard is never executed and removing it would not fail the test.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
mediumError event timestamps (seconds) are compared with replay recording event timestamps (milliseconds), so errors are not interleaved chronologically with breadcrumbs.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
cal.com · TypeScriptsms-workflow-reminder-retry-count-tracking-cal-com
1 disagree · 5 gold bugs
mediumretryCount is set to reminder.retryCount + 1 from a value read at the start of the run instead of an atomic increment, so overlapping runs can lose increments.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe deleteMany OR clause applies retryCount > 1 without the SMS method filter, so the SMS cron deletes any workflow reminder (email, WhatsApp) with retryCount above 1.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
mediumThe retry-count update inside the catch block is not guarded, so if it throws (for example the reminder was deleted concurrently) the error escapes the loop and the cron run fails, skipping the remaining reminders.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
criticalClaims transient errors increment retryCount, so two runs during an outage delete the whole pending SMS reminder queue.DeepSeek V4 Pro missed it · Muse Spark 1.2 missed it
highSMS-sending locks are counted as failed scheduling attempts: scheduleSMS returns undefined for locked users/teams, retryCount is incremented, and after two cron runs the retryCount > 1 cleanup deletes future reminders even if sending is later unlocked.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
Sentry · Pythonspan-buffer-multiprocess-enhancement-with-health-monitoring-sentry
2 disagree · 2 gold bugs
highThe restart path only kills a hung flusher if it is a multiprocessing.Process, but spawn-context workers are SpawnProcess, so hung processes are never killed and a duplicate flusher is started for the same shards.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
mediumjoin() breaks out of the per-process loop when the shared deadline expires, skipping termination of the remaining flusher processes and leaving them running after shutdown.DeepSeek V4 Pro missed it · Muse Spark 1.2 found it
Grafana · Gounified-storage-performance-optimizations-grafana-codex
1 disagree · 3 gold bugs
mediumBuildIndex now locks only the final cache assignment, so concurrent callers for the same uncached key all build the same expensive index in parallel and the last one overwrites the others.DeepSeek V4 Pro found it · Muse Spark 1.2 found it
highThe new startup log calls TotalDocs, which iterates the index cache without a lock, after the event goroutine that can add indexes has started, so a concurrent map read and write can crash the process.DeepSeek V4 Pro found it · Muse Spark 1.2 missed it
mediumThe PR skips the storage-server module integration test on postgres instead of fixing the failure, removing coverage of the new eager initialization on postgres.DeepSeek V4 Pro found it · Muse Spark 1.2 found it