#1655 Failure in prod of the single-package packager workflow
Opened by packagerbot. Modified

A run of monitor-gating has just failed in prod for the single-package workflow.

The suspects are 'koji'.

Full log:

16:01:00 - Cloning as packagerbot the git repo: rpms/dummy-test-package-gloster
16:01:07 - Cloning as packagerbot the git repo: rpms/dummy-test-package-gloster                       [DONE]
16:01:07 - Switching to branch: rawhide
16:01:07 - Switching to branch: rawhide                                                               [DONE]
16:01:07 - Bumping release of: dummy-test-package-gloster.spec
16:01:08 - Bumping release of: dummy-test-package-gloster.spec                                        [DONE]
16:01:08 - Commiting changes
16:01:08 - Commiting changes                                                                          [DONE]
16:01:08 - Getting nevr
16:01:09 - Getting nevr                                                                               [DONE]
16:01:09 - Upcoming build : dummy-test-package-gloster-0-6391.fc36                                    [DONE]
16:01:09 - Pushing changes
16:01:16 - Pushing changes                                                                            [DONE]
16:01:16 - The build should be found on: https://koji.fedoraproject.org/koji/search?match=glob&type=build&terms=dummy-test-package-gloster-0-6391.fc36 [DONE]
16:01:16 - The build should be found in: https://koji.fedoraproject.org/koji/search?match=glob&type=package&terms=dummy-test-package-gloster [DONE]
16:01:16 - Building the package
16:06:19 - Building the package                                                                       [DONE]
16:06:19 - Retrieving koji tags
16:06:19 - Retrieving koji tags: ['f36-updates-candidate', 'f36-updates-testing-pending'] found while expected ['updates-candidate', 'signing-pending'] [DONE]
16:06:19 - Retrieving update created from https://bodhi.fedoraproject.org/updates/?builds=dummy-test-package-gloster-0-6391.fc36
16:06:19 - Retrieving update created from https://bodhi.fedoraproject.org/updates/?builds=dummy-test-package-gloster-0-6391.fc36 [DONE]
16:06:19 - Update automatically created : https://bodhi.fedoraproject.org/updates/FEDORA-2021-96c70f2afe [DONE]
16:06:19 - Retrieving koji tags
16:06:20 - Retrieving koji tags: ['f36-updates-candidate', 'f36-updates-testing-pending'] found while expected ['signing-pending', 'testing-pending'] [DONE]
16:06:20 - Checking datagrepper for bodhi to CI messages
16:06:20 - bodhi to CI results in datagrepper returned  - ran for: 0s                                 [DONE]
16:06:20 - Checking datagrepper for CI (running) messages
16:06:20 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.centos.prod.ci.koji-build.test.running&start=1640188580.179629&row_per_page=10&page=1 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:06:50 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.centos.prod.ci.koji-build.test.running&start=1640188580.179629&row_per_page=10&page=1 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:07:20 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.centos.prod.ci.koji-build.test.running&start=1640188580.179629&row_per_page=10&page=1 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:07:50 - CI (running) results in datagrepper returned running - ran for: 90s                        [DONE]
16:07:50 - Checking datagrepper for CI (complete) messages
16:07:50 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.centos.prod.ci.koji-build.test.complete&start=1640188580.179629&row_per_page=10&page=2 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:08:20 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.centos.prod.ci.koji-build.test.complete&start=1640188580.179629&row_per_page=10&page=2 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:08:50 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.centos.prod.ci.koji-build.test.complete&start=1640188580.179629&row_per_page=10&page=4 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:09:20 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.centos.prod.ci.koji-build.test.complete&start=1640188580.179629&row_per_page=10&page=1 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:09:50 - CI (complete) results in datagrepper returned passed - ran for: 120s                       [DONE]
16:09:50 - Retrieving koji tags
16:09:51 - Retrieving koji tags: ['f36-updates-candidate', 'f36-updates-testing-pending'] found while expected ['testing-pending'] [DONE]
16:09:51 - CI results query from https://taskotron.fedoraproject.org/resultsdb_api/api/v2.0/results&page=0 [DONE]
16:09:51 - Checking resultsdb(phx) for CI results
16:13:07 - CI results in resultsdb(phx) returned org.centos.prod.ci.koji-build.test.complete - ran for: 195s [DONE]
16:13:07 - Checking datagrepper for resultsdb messages
16:13:07 - resultsdb results in datagrepper returned FAILED - ran for: 0s                             [DONE]
16:13:07 - Checking datagrepper for greenwave messages
16:13:07 - greenwave results in datagrepper returned False - ran for: 0s                              [DONE]
16:13:07 - Retrieving koji tags
16:13:07 - Retrieving koji tags: ['f36-updates-candidate', 'f36-updates-testing-pending'] found while expected ['testing-pending'] [DONE]
16:13:07 - Waiving test results for bodhi update
16:13:09 - Waiving test results for bodhi update                                                      [DONE]
16:13:09 - Checking datagrepper for waiverdb messages
16:13:09 - waiverdb results in datagrepper returned  - ran for: 0s                                    [DONE]
16:13:09 - Checking datagrepper for greenwave messages
16:13:09 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.fedoraproject.prod.greenwave.decision.update&start=1640188580.179629&row_per_page=10&page=1 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:13:39 - No messages in data-grepper on https://apps.fedoraproject.org/datagrepper/raw?topic=org.fedoraproject.prod.greenwave.decision.update&start=1640188580.179629&row_per_page=10&page=1 Can't reconnect until invalid transaction is rolled back (original cause: InvalidRequestError: Can't reconnect until invalid transaction is rolled back) u'SELECT count(*) AS count_1 \nFROM (SELECT messages.id AS messages_id, messages.msg_id AS messages_msg_id, messages.i AS messages_i, messages.topic AS messages_topic, messages.timestamp AS messages_timestamp, messages.certificate AS messages_certificate, messages.signature AS messages_signature, messages.category AS messages_category, messages.username AS messages_username, messages.crypto AS messages_crypto, messages.source_name AS messages_source_name, messages.source_version AS messages_source_version, messages._msg AS messages__msg, messages._headers AS messages__headers \nFROM messages \nWHERE messages.timestamp BETWEEN %(timestamp_1)s AND %(timestamp_2)s AND messages.topic = %(topic_1)s) AS anon_1' [immutabledict({})]
16:14:09 - greenwave results in datagrepper returned True - ran for: 60s                              [DONE]
16:14:09 - Retrieving koji tags
16:29:27 - Retrieving koji tags: ['f36-updates-candidate', 'f36-updates-testing-pending'] found while expected f36 [FAILED]
Ran for 1706 seconds (28.43 minutes)

Metadata