I really messed up my mirrors and updates

[anime]

Here I go again being negligent of doing frequent updates and only updating packages I use frequently while ignoring system updates so I’ve like 700+ pending updates including system updates…ig I didn’t learn yet…

I’ve tried to update a couple of packages, I guess this is known as partially update, well I wasn’t paying attention I’m know not able to update anything even AUR packages.

Here are the issues I’ve found so far:

• Welcome dialog doesn’t open on system start.
• GPGME error: No data.
• failed to synchronize all databases (unexpected error).

I’ve tried a bunch of solutions online from keyrings and deleting pacman sync to other things I did for the sake of doing (sounds bad IK), now I’m faced with the potential boot from usb to fix or do a clean installation.

here is the a debug message that might be telling about what my issue can be:

[azelk@azelk-hqlocalmachine ~]$ sudo pacman -Syu --debug
debug: pacman v6.0.2 - libalpm v13.0.2
debug: config: attempting to read file /etc/pacman.conf
debug: config: new section 'options'
debug: config: HoldPkg: pacman
debug: config: HoldPkg: glibc
debug: config: Architecture: auto
debug: config: arch: x86_64
debug: config: chomp
debug: config: verbosepkglists
debug: config: SigLevel: Required
debug: config: SigLevel: DatabaseOptional
debug: config: LocalFileSigLevel: Optional
debug: config: new section 'endeavouros'
debug: config: SigLevel: PackageRequired
debug: config file /etc/pacman.conf, line 78: including /etc/pacman.d/endeavouros-mirrorlist
debug: config: new section 'core'
debug: config file /etc/pacman.conf, line 84: including /etc/pacman.d/mirrorlist
debug: config: new section 'extra'
debug: config file /etc/pacman.conf, line 87: including /etc/pacman.d/mirrorlist
debug: config: new section 'community'
debug: config file /etc/pacman.conf, line 93: including /etc/pacman.d/mirrorlist
debug: config: new section 'multilib'
debug: config file /etc/pacman.conf, line 102: including /etc/pacman.d/mirrorlist
debug: config: finished parsing /etc/pacman.conf
debug: setup_libalpm called
debug: option 'logfile' = /var/log/pacman.log
debug: option 'gpgdir' = /etc/pacman.d/gnupg/
debug: option 'hookdir' = /etc/pacman.d/hooks/
debug: option 'cachedir' = /var/cache/pacman/pkg/
debug: registering sync database 'endeavouros'
debug: database path for tree endeavouros set to /var/lib/pacman/sync/endeavouros.db
debug: GPGME version: 1.18.0
debug: GPGME engine info: file=/usr/bin/gpg, home=/etc/pacman.d/gnupg/
debug: checking signature for /var/lib/pacman/sync/endeavouros.db
error: GPGME error: No data
debug: returning error 53 from _alpm_gpgme_checksig (../lib/libalpm/signing.c: 778) : gpgme error
debug: signature check failed
debug: setting usage of 15 for endeavouros repository
debug: adding new server URL to database 'endeavouros': https://mirror.jordanrey.me/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.moson.org/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://de.freedif.org/EndeavourOS/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://fastmirror.pp.ua/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://endeavour.remi.lu/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://md.mirrors.hacktegic.com/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://ftp.acc.umu.se/mirror/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.alpix.eu/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.freedif.org/EndeavourOS/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://ca.gate.endeavouros.com/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.jingk.ai/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.albony.xyz/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.funami.tech/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.archlinux.tw/EndeavourOS/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirrors.tuna.tsinghua.edu.cn/endeavouros/repo/endeavouros/x86_64
debug: adding new server URL to database 'endeavouros': https://mirror.linux.pizza/endeavouros/repo/endeavouros/x86_64
debug: registering sync database 'core'
debug: database path for tree core set to /var/lib/pacman/sync/core.db
debug: "/var/lib/pacman/sync/core.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/core.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: setting usage of 15 for core repository
debug: adding new server URL to database 'core': http://archlinux.uk.mirror.allworldit.com/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': http://mirror.librelabucm.org/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': http://mirrors.melbourne.co.uk/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': http://lon.mirror.rackspace.com/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': http://www.mirrorservice.org/sites/ftp.archlinux.org/core/os/x86_64
debug: adding new server URL to database 'core': https://mirror.librelabucm.org/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': https://archlinux.uk.mirror.allworldit.com/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': https://lon.mirror.rackspace.com/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': https://www.mirrorservice.org/sites/ftp.archlinux.org/core/os/x86_64
debug: adding new server URL to database 'core': https://mirrors.melbourne.co.uk/archlinux/core/os/x86_64
debug: adding new server URL to database 'core': https://geo.mirror.pkgbuild.com/core/os/x86_64
debug: registering sync database 'extra'
debug: database path for tree extra set to /var/lib/pacman/sync/extra.db
debug: "/var/lib/pacman/sync/extra.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/extra.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: setting usage of 15 for extra repository
debug: adding new server URL to database 'extra': http://archlinux.uk.mirror.allworldit.com/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': http://mirror.librelabucm.org/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': http://mirrors.melbourne.co.uk/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': http://lon.mirror.rackspace.com/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': http://www.mirrorservice.org/sites/ftp.archlinux.org/extra/os/x86_64
debug: adding new server URL to database 'extra': https://mirror.librelabucm.org/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': https://archlinux.uk.mirror.allworldit.com/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': https://lon.mirror.rackspace.com/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': https://www.mirrorservice.org/sites/ftp.archlinux.org/extra/os/x86_64
debug: adding new server URL to database 'extra': https://mirrors.melbourne.co.uk/archlinux/extra/os/x86_64
debug: adding new server URL to database 'extra': https://geo.mirror.pkgbuild.com/extra/os/x86_64
debug: registering sync database 'community'
debug: database path for tree community set to /var/lib/pacman/sync/community.db
debug: "/var/lib/pacman/sync/community.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/community.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: setting usage of 15 for community repository
debug: adding new server URL to database 'community': http://archlinux.uk.mirror.allworldit.com/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': http://mirror.librelabucm.org/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': http://mirrors.melbourne.co.uk/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': http://lon.mirror.rackspace.com/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': http://www.mirrorservice.org/sites/ftp.archlinux.org/community/os/x86_64
debug: adding new server URL to database 'community': https://mirror.librelabucm.org/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': https://archlinux.uk.mirror.allworldit.com/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': https://lon.mirror.rackspace.com/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': https://www.mirrorservice.org/sites/ftp.archlinux.org/community/os/x86_64
debug: adding new server URL to database 'community': https://mirrors.melbourne.co.uk/archlinux/community/os/x86_64
debug: adding new server URL to database 'community': https://geo.mirror.pkgbuild.com/community/os/x86_64
debug: registering sync database 'multilib'
debug: database path for tree multilib set to /var/lib/pacman/sync/multilib.db
debug: "/var/lib/pacman/sync/multilib.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/multilib.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: setting usage of 15 for multilib repository
debug: adding new server URL to database 'multilib': http://archlinux.uk.mirror.allworldit.com/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': http://mirror.librelabucm.org/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': http://mirrors.melbourne.co.uk/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': http://lon.mirror.rackspace.com/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': http://www.mirrorservice.org/sites/ftp.archlinux.org/multilib/os/x86_64
debug: adding new server URL to database 'multilib': https://mirror.librelabucm.org/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': https://archlinux.uk.mirror.allworldit.com/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': https://lon.mirror.rackspace.com/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': https://www.mirrorservice.org/sites/ftp.archlinux.org/multilib/os/x86_64
debug: adding new server URL to database 'multilib': https://mirrors.melbourne.co.uk/archlinux/multilib/os/x86_64
debug: adding new server URL to database 'multilib': https://geo.mirror.pkgbuild.com/multilib/os/x86_64
:: Synchronising package databases...
 endeavouros downloading...
 core downloading...
 extra downloading...
 community downloading...
 multilib downloading...
debug: endeavouros.db: url is https://mirror.jordanrey.me/endeavouros/repo/endeavouros/x86_64/endeavouros.db
debug: endeavouros.db: maxsize 134217728
debug: endeavouros.db: opened tempfile for download: /var/lib/pacman/sync/endeavouros.db.part (wb)
debug: core.db: url is http://archlinux.uk.mirror.allworldit.com/archlinux/core/os/x86_64/core.db
debug: core.db: maxsize 134217728
debug: core.db: using time condition 1701629829
debug: core.db: opened tempfile for download: /var/lib/pacman/sync/core.db.part (wb)
debug: extra.db: url is http://archlinux.uk.mirror.allworldit.com/archlinux/extra/os/x86_64/extra.db
debug: extra.db: maxsize 134217728
debug: extra.db: using time condition 1701641797
debug: extra.db: opened tempfile for download: /var/lib/pacman/sync/extra.db.part (wb)
debug: community.db: url is http://archlinux.uk.mirror.allworldit.com/archlinux/community/os/x86_64/community.db
debug: community.db: maxsize 134217728
debug: community.db: using time condition 1684576230
debug: community.db: opened tempfile for download: /var/lib/pacman/sync/community.db.part (wb)
debug: multilib.db: url is http://archlinux.uk.mirror.allworldit.com/archlinux/multilib/os/x86_64/multilib.db
debug: multilib.db: maxsize 134217728
debug: multilib.db: using time condition 1701270504
debug: multilib.db: opened tempfile for download: /var/lib/pacman/sync/multilib.db.part (wb)
debug: core.db: curl returned result 0 from transfer
debug: core.db: response code 304
debug: core.db.sig: url is http://archlinux.uk.mirror.allworldit.com/archlinux/core/os/x86_64/core.db.sig
debug: core.db.sig: maxsize 16384
debug: core.db.sig: opened tempfile for download: /var/lib/pacman/sync/core.db.sig.part (wb)
debug: core.db: file met time condition
debug: community.db: curl returned result 0 from transfer
debug: community.db: response code 304
debug: community.db.sig: url is http://archlinux.uk.mirror.allworldit.com/archlinux/community/os/x86_64/community.db.sig
debug: community.db.sig: maxsize 16384
debug: community.db.sig: opened tempfile for download: /var/lib/pacman/sync/community.db.sig.part (wb)
debug: community.db: file met time condition
debug: extra.db: curl returned result 0 from transfer
debug: extra.db: response code 304
debug: extra.db.sig: url is http://archlinux.uk.mirror.allworldit.com/archlinux/extra/os/x86_64/extra.db.sig
debug: extra.db.sig: maxsize 16384
debug: extra.db.sig: opened tempfile for download: /var/lib/pacman/sync/extra.db.sig.part (wb)
debug: extra.db: file met time condition
debug: multilib.db: curl returned result 0 from transfer
debug: multilib.db: response code 304
debug: multilib.db.sig: url is http://archlinux.uk.mirror.allworldit.com/archlinux/multilib/os/x86_64/multilib.db.sig
debug: multilib.db.sig: maxsize 16384
debug: multilib.db.sig: opened tempfile for download: /var/lib/pacman/sync/multilib.db.sig.part (wb)
debug: multilib.db: file met time condition
debug: core.db.sig: curl returned result 0 from transfer
debug: core.db.sig: response code 404
debug: core.db.sig: no more servers to retry
debug: community.db.sig: curl returned result 0 from transfer
debug: community.db.sig: response code 404
debug: community.db.sig: no more servers to retry
debug: multilib.db.sig: curl returned result 0 from transfer
debug: multilib.db.sig: response code 404
debug: multilib.db.sig: no more servers to retry
debug: extra.db.sig: curl returned result 0 from transfer
debug: extra.db.sig: response code 404
debug: extra.db.sig: no more servers to retry
debug: endeavouros.db: curl returned result 0 from transfer
debug: endeavouros.db: response code 200
debug: endeavouros.db?subid1=20231204-0922-06e4-a25f-46f02bb5528b.sig: url is http://ww25.mirror.jordanrey.me/endeavouros/repo/endeavouros/x86_64/endeavouros.db?subid1=20231204-0922-06e4-a25f-46f02bb5528b.sig
debug: endeavouros.db?subid1=20231204-0922-06e4-a25f-46f02bb5528b.sig: maxsize 16384
debug: endeavouros.db?subid1=20231204-0922-06e4-a25f-46f02bb5528b.sig: opened tempfile for download: /var/lib/pacman/sync/endeavouros.db?subid1=20231204-0922-06e4-a25f-46f02bb5528b.sig.part (wb)
debug: endeavouros.db?subid1=20231204-0922-06e4-a25f-46f02bb5528b.sig: curl returned result 0 from transfer
debug: endeavouros.db?subid1=20231204-0922-06e4-a25f-46f02bb5528b.sig: response code 200
debug: curl_download_internal return code is 0
debug: checking signature for /var/lib/pacman/sync/endeavouros.db
error: GPGME error: No data
debug: returning error 53 from _alpm_gpgme_checksig (../lib/libalpm/signing.c: 778) : gpgme error
debug: signature check failed
debug: failed to validate db: endeavouros
debug: "/var/lib/pacman/sync/core.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/core.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: "/var/lib/pacman/sync/extra.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/extra.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: "/var/lib/pacman/sync/community.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/community.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: "/var/lib/pacman/sync/multilib.db.sig" is not readable: No such file or directory
debug: sig path /var/lib/pacman/sync/multilib.db.sig could not be opened
debug: got error 43 at _alpm_gpgme_checksig (../lib/libalpm/signing.c: 603) : missing PGP signature
debug: missing optional signature
debug: failed to sync dbs: unexpected error
error: failed to synchronize all databases (unexpected error)
debug: unregistering database 'local'
debug: unregistering database 'endeavouros'
debug: unregistering database 'core'
debug: unregistering database 'extra'
debug: unregistering database 'community'
debug: unregistering database 'multilib'

[anime]

Also the occasional error when running installs

/usr/lib/X_EXAMPLE not found errors

[pebcak]

@anime

error: GPGME error: No data

https://wiki.archlinux.org/title/Pacman#error:_GPGME_error:_No_data

HTH

[drunkenvicar]

@anime

and only updating packages I use frequently while ignoring system updates

How does one get to this place? Just a fear of your system getting borked? I’ve been with Endeavour about half a year now, so 160 days? Of 160 days, updating daily, one system update wrecked my operating system, it was unrecoverable, and I had to reinstall. The other 159 updates did not do this. So it’s inevitable is my bummer message?

fix mirrors with reflector --protocol https --verbose --latest 25 --sort rate --save /etc/pacman.d/mirrorlist followed by eos-rankmirrors --verbose

if it was me I would ask this forum, 1) is there a pacman/yay command to check for broken packages? and 2) is there a pacman/yay command to fix broken packages?
I always wanted to know if these commands existed so I could add them to my maint. list. 2 cents and good luck.

[eznix]

After you run the reflector commands given by drunkenvicar (assuming they are correct), you can try these commands to completely wipe and replace the keyrings:

sudo rm /var/lib/pacman/sync/*
sudo rm -rf /etc/pacman.d/gnupg/*
sudo pacman-key --init
sudo pacman-key --populate
sudo pacman -S --noconfirm archlinux-keyring endeavouros-keyring

Since I don’t use EndeavourOS, I was guessing at the endeavouros-keyring package, but if that is the correct name, then the above commands should clean out and reinstall the keyrings.

If anyone can correct any mistake I made, please do so. I use the above commands on my Arch install with very good results.

[ddnn]

@anime

…only updating packages I use frequently while ignoring system updates so I’ve like 700+ pending updates including system updates…ig I didn’t learn yet…

I’ve tried to update a couple of packages, I guess this is known as partially update, well I wasn’t paying attention…

PS (pre-script): This isn’t meant to offend, it’s a genuine question with a genuinely suggested solution.

Question: Why do you use an Arch-based distro?

Why do I ask?
→ You have been treating your system the way many M$ W1nd0z3 users treat theirs, and apart from BSD, Arch-based distros are about as opposite as you can get from M$ W1nd0z3.

The other reason I ask is that you should maybe consider using something Debian-based paired with Distrobox. This way, you’d barely have any system updates, and you can just update your favourite apps, like you’ve been doing.

If you don’t want to part ways with Arch, then please, at least update once a week. I’ve heard you can even go for a month and be fine, but I’ll never test that.

@eznix

Since I don’t use EndeavourOS, I was guessing at the endeavouros-keyring package, but if that is the correct name, then the above commands should clean out and reinstall the keyrings.

If anyone can correct any mistake I made, please do so. I use the above commands on my Arch install with very good results.

It’s correct.

[Stagger_Lee]

The OP was told back in February 2022 that updates should be performed more frequently:

@dalto

You definitely need to update more frequently. When you update after months of not updating it makes the update process much more risky.

And the reply was:

@anime

I agree, a lesson learned.

Hmm, apparently not . Then partial upgrading was added to the mix. Not a good idea.

@ddnn

please, at least update once a week. I’ve heard you can even go for a month and be fine, but I’ll never test that.

How about 3 years?

Arch installation updated after 3 years of neglect

While updating an SSD that used to be my daily driver (the Debian-base SolydXK), but was replaced a few years ago, I found that I still had an old Virtualbox Arch installation on it. I had not updated it since June 27, 2020 (OK, so not 3 years, but 2 years 11 months, close enough). It was running on kernel 5.7, and as you can see, the last activity in /var/log/pacman.log was 2020: [update_01] There have been a lot of changes in the last 3 years…let’s get this party started. First off, we have…

[ddnn]

@Stagger_Lee

The OP was told back in February 2022 that updates should be performed more frequently:

@dalto

You definitely need to update more frequently. When you update after months of not updating it makes the update process much more risky.

And the reply was:

@anime

I agree, a lesson learned.

Hmm, apparently not . Then partial upgrading was added to the mix. Not a good idea.

Mmhm… Yeah, users like these don’t deserve a second of consideration or help. Sorry, not sorry. Had to be said. In fact, I am muting the OP’s posts from now on. Of course, whoever decides to help, great!

@Stagger_Lee

How about 3 years?

While updating an SSD that used to be my daily driver (the Debian-base SolydXK), but was replaced a few years ago, I found that I still had an old Virtualbox Arch installation on it. I had not updated it since June 27, 2020 (OK, so not 3 years, but 2 years 11 months, close enough). It was running on kernel 5.7, and as you can see, the last activity in /var/log/pacman.log was 2020: [update_01] There have been a lot of changes in the last 3 years…let’s get this party started. First off, we have…

WOW! I’d rather just reinstall than try that on a real system . I mean, apart from installing all the packages again, it’s way faster.

[anime]

Thank you all, it looks like I managed to survive this time without doing a fresh install, I used the commands listed above and I had to roam around for a bit more help to understand as it turns out a mirror or two were bad and I had to update the mirrorlist manually using the mirrorlist page from the website and endeavouros-mirrorlist to comment a bad link that was ranked higher then the update went smoothly.

[HMS_Endeavour]

@anime

Thank you all, it looks like I managed to survive this time without doing a fresh install, I used the commands listed above

Please mark the post that solved your problem.
Please take all the good advice above.
You may find this Maintenance guide useful