Mirror easylee 404's, after resorting mirrors pacman -Syu does not match checkupdates

ReemZ · July 19, 2021, 11:46am

Not sure if the two issues in the title are related, but the following happened.
First, I do a checkupdates (ch is an alias):

$ ch
imagemagick 7.1.0.2-2 -> 7.1.0.4-1
mesa 21.1.4-1 -> 21.1.5-1
pacman-mirrorlist 20210509-1 -> 20210718-1
python-pep517 0.10.0-2 -> 0.11.0-1
python-setuptools 1:57.2.0-1 -> 1:57.3.0-1
vulkan-icd-loader 1.2.183-1 -> 1.2.184-1

I then decide to run the update (up is an alias):

$ up
[sudo] password for reemz: 
:: Synchronising package databases...
 core                                                                    133.5 KiB   890 KiB/s 00:00 [-----------------------------------------------------------] 100%
 extra                                                                  1567.2 KiB  3.89 MiB/s 00:00 [-----------------------------------------------------------] 100%
 community                                                                 3.2 MiB  4.65 MiB/s 00:00 [---------------------------------C o  o  o  o  o  o  o  o  ]  57%
 community                                                                 5.6 MiB  7.77 MiB/s 00:01 [-----------------------------------------------------------] 100%
 endeavouros                                                              18.6 KiB   126 KiB/s 00:00 [-----------------------------------------------------------] 100%

error: failed retrieving file 'core.db' from mirror.easylee.nl : The requested URL returned error: 404
error: failed retrieving file 'extra.db' from mirror.easylee.nl : The requested URL returned error: 404
error: failed retrieving file 'community.db' from mirror.easylee.nl : The requested URL returned error: 404
warning: too many errors from mirror.easylee.nl, skipping for the remainder of this transaction
error: failed retrieving file 'multilib.db' from mirror.easylee.nl : The requested URL returned error: 404
:: Starting full system upgrade...
resolving dependencies...
looking for conflicting packages...

Packages (7) imagemagick-7.1.0.4-1  mesa-21.1.5-1  pacman-mirrorlist-20210718-1  python-pep517-0.11.0-1  python-setuptools-1:57.3.0-1  python-tomli-1.0.4-1
             vulkan-icd-loader-1.2.184-1

Total Download Size:    20.73 MiB
Total Installed Size:  111.82 MiB
Net Upgrade Size:        0.08 MiB

:: Proceed with installation? [Y/n] n

Cleaned the entire cache (like I always do after every pacman operation) and retried once more, same result, so I decided to run Reflector Simple, with the following result:

mirrorlist

$ cat /etc/pacman.d/mirrorlist
################################################################################
################# Arch Linux mirrorlist generated by Reflector #################
################################################################################
# With:       reflector --verbose -c NL --protocol https --sort rate --latest 10
# When:       2021-07-19 11:32:21 UTC
# From:       https://archlinux.org/mirrors/status/json/
# Retrieved:  2021-07-19 11:32:03 UTC
# Last Check: 2021-07-19 10:51:18 UTC

## Netherlands
Server = https://mirrors.xtom.nl/archlinux/$repo/os/$arch

## Netherlands
Server = https://mirror.erickochen.nl/archlinux/$repo/os/$arch

## Netherlands
Server = https://mirror.koddos.net/archlinux/$repo/os/$arch

## Netherlands
Server = https://mirror.lyrahosting.com/archlinux/$repo/os/$arch

## Netherlands
Server = https://mirror.cj2.nl/archlinux/$repo/os/$arch

## Netherlands
Server = https://mirrors.daan.vodka/archlinux/$repo/os/$arch

## Netherlands
Server = https://mirror.ams1.nl.leaseweb.net/archlinux/$repo/os/$arch

## Netherlands
Server = https://archlinux.mirror.wearetriple.com/$repo/os/$arch

## Netherlands
Server = https://arch.mirrors.lavatech.top/$repo/os/$arch

## Netherlands
Server = https://archlinux.mirror.liteserver.nl/$repo/os/$arch

Repeated the process, check first:

$ ch
imagemagick 7.1.0.2-2 -> 7.1.0.4-1
mesa 21.1.4-1 -> 21.1.5-1
pacman-mirrorlist 20210509-1 -> 20210718-1
python-pep517 0.10.0-2 -> 0.11.0-1
python-setuptools 1:57.2.0-1 -> 1:57.3.0-1
vulkan-icd-loader 1.2.183-1 -> 1.2.184-1

Okay, no more python-tomli in the list, no idea why, and it’s not installed on my system, nor does it seem (pacman -Si) to be required by anything. Whatever. I decide to run the update:

$ up
:: Synchronising package databases...
 core                                                                    133.5 KiB   405 KiB/s 00:00 [-----------------------------------------------------------] 100%
 extra                                                                  1567.0 KiB  2.62 MiB/s 00:01 [-----------------------------------------------------------] 100%
 community                                                                 5.6 MiB  5.58 MiB/s 00:01 [-----------------------------------------------------------] 100%
 multilib                                                                149.7 KiB   435 KiB/s 00:00 [-----------------------------------------------------------] 100%
 endeavouros                                                              18.6 KiB  77.4 KiB/s 00:00 [-----------------------------------------------------------] 100%
:: Starting full system upgrade...
resolving dependencies...
looking for conflicting packages...

Packages (5) imagemagick-7.1.0.4-1  mesa-21.1.5-1  pacman-mirrorlist-20210718-1  python-setuptools-1:57.3.0-1  vulkan-icd-loader-1.2.184-1

Total Download Size:    20.69 MiB
Total Installed Size:  111.63 MiB
Net Upgrade Size:        0.01 MiB

:: Proceed with installation? [Y/n]

Wait…according to checkupdates there was an update to python-pep517, but now there’s not?

Have I broken something or is my understanding of pacman just failing hard again?

flyingcakes · July 19, 2021, 12:31pm

I don’t think they host packages for Arch Linux. Their website doesn’t mention Arch, and easylee is not listed on Arch Linux mirror status page.
https://archlinux.org/mirrors/status/

Possibly, checkupdates does not use your mirror list to fetch database. The first mirror in your mirrorlist, mirrors.xtom.nl may not have been synced as recently as whatever mirror checkupdates is using.

Run reflector with the --latest flag. That should give you the most recent mirrors.

reflector --latest 10 --sort rate --verbose --save /etc/pacman.d/mirrorlist

The latest version of python-pep57 is 0.11.0.
https://archlinux.org/packages/extra/any/python-pep517/

pebcak · July 19, 2021, 12:36pm

How about pacman -Syyu instead of -Syu after resorting the mirrors to force a refresh of all package databases?

freebird54 · July 19, 2021, 1:41pm

The only mirror I know of (actually 2 of them, one running and one not currently) are chaotic-aur mirrors, not Arch. Have you accidentally cross-posted items in different mirrorlists?

NO - I have no idea why there are 2 entries with that name, but my mirror console shows one of them is disconnected at the moment, and the other is up-to-date and running fine…

ReemZ · July 19, 2021, 2:16pm

No idea how they ended up in the list then, I never manually added anything.

Just exactly how does it do what it does then? Should I even bother with it?

To clarify, up is an alias to pacman -Syyuu. I always force a refresh, I always completely wipe the cache when done, and I allow for the odd downgrade (though if it ever wants to, I do check what’s going on before committing).

Heard the name, no idea what it is as I never bothered looking into it. I don’t have anything installed from the AUR, only from the official repos.

I’ll just go with

and run the update again.

ReemZ · July 19, 2021, 2:26pm

Probably not much of a problem, but a couple of mirrors aren’t cooperating:

[2021-07-19 16:19:23] INFO: rating 10 mirror(s) by download speed
[2021-07-19 16:19:23] INFO: Server                                               Rate       Time
[2021-07-19 16:19:25] INFO: http://arch.mirror.square-r00t.net/         3069.52 KiB/s     1.87 s
[2021-07-19 16:19:26] INFO: https://arch.mirror.square-r00t.net/        6200.87 KiB/s     0.92 s
[2021-07-19 16:19:26] WARNING: failed to rate rsync download (rsync://arch.mirror.square-r00t.net/arch/community/os/x86_64/community.db): [Errno 2] No such file or directory: 'rsync'
[2021-07-19 16:19:26] INFO: rsync://arch.mirror.square-r00t.net/arch/      0.00 KiB/s     0.00 s
[2021-07-19 16:19:27] INFO: http://mirror.telepoint.bg/archlinux/       7808.12 KiB/s     0.73 s
[2021-07-19 16:19:28] INFO: https://mirror.telepoint.bg/archlinux/      6183.48 KiB/s     0.93 s
[2021-07-19 16:19:28] WARNING: failed to rate rsync download (rsync://mirror.telepoint.bg/archlinux/community/os/x86_64/community.db): [Errno 2] No such file or directory: 'rsync'
[2021-07-19 16:19:28] INFO: rsync://mirror.telepoint.bg/archlinux/         0.00 KiB/s     0.00 s
[2021-07-19 16:19:33] WARNING: failed to rate http(s) download (http://mirror.lty.me/archlinux/community/os/x86_64/community.db): Download timed out after 5 second(s).
[2021-07-19 16:19:33] INFO: http://mirror.lty.me/archlinux/                0.00 KiB/s     0.00 s
[2021-07-19 16:19:34] INFO: https://mirror.osbeck.com/archlinux/       12703.63 KiB/s     0.45 s
[2021-07-19 16:19:35] INFO: http://archlinux.thaller.ws/                5844.99 KiB/s     0.98 s
[2021-07-19 16:19:36] INFO: https://archlinux.thaller.ws/               5996.76 KiB/s     0.96 s

Ran the update without problems, unsure whether any of this is even useful information tbh…

flyingcakes · July 19, 2021, 2:47pm

Ah rsync mirrors don’t always work with reflector for some reason. It’s not a problem.

Btw, after update what is the version of python-pep57?

flyingcakes · July 19, 2021, 2:53pm

Also, looking at the source code, it seems like my earlier assumption was wrong. Check updates is using Pacman?

manuel · July 19, 2021, 3:02pm

Easylee was one of the Arch mirrors in May this year, but the latest Arch mirrorlist does not include it anymore.

You can download the latest Arch mirrorlist (containing all currently working mirrors) with command:

wget -O /tmp/mirrorlist https://www.archlinux.org/mirrorlist/all

into the /tmp folder.

As already said here, some mirrors are more up-to-date than others.
reflector-simple by default creates a mirrorlist using the latest 10 mirrors, so that should be OK.

Your reflector-simple output shows the command:

reflector --verbose -c NL --protocol https --sort rate --latest 10

I don’t know how German mirrors work for you, but you might want to try them too as they usually are in good shape. Wheather to use reflector-simple or reflector doesn’t really matter, they do essentially the same thing.

Edit: checkupdates uses (as far as I know) exactly the same mirrors as pacman.

ReemZ · July 19, 2021, 8:18pm

0.11.0-1, as expected

easylee · July 20, 2021, 1:58pm

To give some background information regarding the mirror.

Some of the content, including Arch, has moved from mirror.easylee.nl to mirror.erickochen.nl

This has to do with hardware specifications and the faster uplink I have available at mirror.erickochen.nl

I am planning to move EndeavourOS later this year as well. That will be a nice upgrade.

manuel · July 20, 2021, 3:21pm

Thanks for the interesting information!
Looking forward to seeing your upgraded EndeavourOS mirror!

Bryanpwo · July 20, 2021, 4:03pm

Thanks for the heads-up.