Missing AUR Packages: python-sgmllib

Scotty_Trees · October 19, 2021, 5:36pm

Greetings lovely community,

Recently ran yay and I noticed I got this message at the end of my updates:

:: Searching databases for updates...
:: Searching AUR for updates...
 -> Missing AUR Packages:  python-sgmllib
 -> Flagged Out Of Date AUR Packages:  gdm-prime  libgdm-prime
 there is nothing to do

Now I’ve seen “Missing AUR Packages” before (here) and in those cases, I’ve been advised to try removing it so long as there is nothing else that it would remove, it should be okay to remove it. I haven’t yet seen a post about python-sgmllib here, so I figured I’d post about it really quick. When I try searching the Arch website and the Arch AUR website search for the python-sgmllib package, nothing comes up, so I assume the package was removed for whatever reason(s). There is a similar named package called python-sgmllib3k in the AUR, but I don’t believe I need that package.

So I went ahead and removed the package:

sudo pacman -Rc python-sgmllib

And it didn’t show it would remove anything else, which I think means that’s safe to remove, so I removed the package and pacman removed it without any errors to report.

I’m not sure IF that was the correct course of action for this package or not, so if anyone can simply confirm what I have done is okay, or if I should have gone about it in a different way, please let me know so I can learn and become more confident Arch world, thank you!

I’ll leave the terminal outputs in case that helps below.

yay output when I first saw the “Missing AUR Package” message show up:

[scott@endeavourOS ~]$ checkupdates; yay -Qua
mpg123 1.29.0-1 -> 1.29.1-1
python-feedparser 5.2.1-9 -> 6.0.1-1
qt5-base 5.15.2+kde+r243-1 -> 5.15.2+kde+r247-1
welcome 3.16.5-1 -> 3.16.6-1
tauon-music-box 6.7.1-1 -> 6.8.0-1
[scott@endeavourOS ~]$ yay
[sudo] password for scott: 
:: Synchronizing package databases...
 core is up to date
 extra                1569.1 KiB   386 KiB/s 00:04 [-----------------------] 100%
 community               5.8 MiB   488 KiB/s 00:12 [-----------------------] 100%
 multilib              149.2 KiB   130 KiB/s 00:01 [-----------------------] 100%
 endeavouros            21.3 KiB  23.0 KiB/s 00:01 [-----------------------] 100%
:: Starting full system upgrade...
resolving dependencies...
looking for conflicting packages...

warning: insufficient columns available for table display
Packages (4) mpg123-1.29.1-1  python-feedparser-6.0.1-1
             qt5-base-5.15.2+kde+r247-1  welcome-3.16.6-1

Total Download Size:   13.56 MiB
Total Installed Size:  66.64 MiB
Net Upgrade Size:       0.17 MiB

:: Proceed with installation? [Y/n] 
:: Retrieving packages...
 welcome-3.16.6-1-any   31.7 KiB  48.8 KiB/s 00:01 [-----------------------] 100%
 python-feedparse...   106.2 KiB   159 KiB/s 00:01 [-----------------------] 100%
 mpg123-1.29.1-1-...   433.4 KiB   375 KiB/s 00:01 [-----------------------] 100%
 qt5-base-5.15.2+...    13.0 MiB  1156 KiB/s 00:12 [-----------------------] 100%
 Total (4/4)            13.6 MiB  1198 KiB/s 00:12 [-----------------------] 100%
(4/4) checking keys in keyring                     [-----------------------] 100%
(4/4) checking package integrity                   [-----------------------] 100%
(4/4) loading package files                        [-----------------------] 100%
(4/4) checking for file conflicts                  [-----------------------] 100%
(4/4) checking available disk space                [-----------------------] 100%
:: Processing package changes...
(1/4) upgrading mpg123                             [-----------------------] 100%
(2/4) upgrading python-feedparser                  [-----------------------] 100%
(3/4) upgrading qt5-base                           [-----------------------] 100%
(4/4) upgrading welcome                            [-----------------------] 100%
:: Running post-transaction hooks...
(1/3) Arming ConditionNeedsUpdate...
(2/3) Checking which packages need to be rebuilt
(3/3) Updating the desktop file MIME type cache...
:: Searching databases for updates...
:: Searching AUR for updates...
 -> Missing AUR Packages:  python-sgmllib
 -> Flagged Out Of Date AUR Packages:  gdm-prime  libgdm-prime
:: 1 Packages to upgrade.
1  aur/tauon-music-box  6.7.1-1 -> 6.8.0-1
==> Packages to exclude: (eg: "1 2 3", "1-3", "^4" or repo name)
==> 
:: Checking for conflicts...
:: Checking for inner conflicts...
[Repo:1]  python-natsort-7.1.1-2
[Aur:1]  tauon-music-box-6.8.0-1

  1 tauon-music-box                  (Installed) (Build Files Exist)
==> Packages to cleanBuild?
==> [N]one [A]ll [Ab]ort [I]nstalled [No]tInstalled or (1 2 3, 1-3, ^4)
==> 
:: (1/1) Downloaded PKGBUILD: tauon-music-box
  1 tauon-music-box                  (Installed) (Build Files Exist)
==> Diffs to show?
==> [N]one [A]ll [Ab]ort [I]nstalled [No]tInstalled or (1 2 3, 1-3, ^4)
==> 
:: (1/1) Parsing SRCINFO: tauon-music-box
:: Synchronizing package databases...
 core is up to date
 extra is up to date
 community is up to date
 multilib is up to date
 endeavouros is up to date
resolving dependencies...
looking for conflicting packages...

Package (1)               New Version  Net Change  Download Size

community/python-natsort  7.1.1-2        0.30 MiB       0.05 MiB

Total Download Size:   0.05 MiB
Total Installed Size:  0.30 MiB

:: Proceed with installation? [Y/n] 
:: Retrieving packages...
 python-natsort-7...    52.9 KiB   252 KiB/s 00:00 [-----------------------] 100%
(1/1) checking keys in keyring                     [-----------------------] 100%
(1/1) checking package integrity                   [-----------------------] 100%
(1/1) loading package files                        [-----------------------] 100%
(1/1) checking for file conflicts                  [-----------------------] 100%
(1/1) checking available disk space                [-----------------------] 100%
:: Processing package changes...
(1/1) installing python-natsort                    [-----------------------] 100%
Optional dependencies for python-natsort
    python-fastnumbers: more efficient sorting
    python-pyicu: sort in locale dependant manner
:: Running post-transaction hooks...
(1/1) Arming ConditionNeedsUpdate...
==> Making package: tauon-music-box 6.8.0-1 (Tue 19 Oct 2021 09:39:10 AM EDT)
==> Retrieving sources...
  -> Downloading tauon-music-box-6.8.0.tar.gz...
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100   129  100   129    0     0    602      0 --:--:-- --:--:-- --:--:--   605
100  847k    0  847k    0     0  1102k      0 --:--:-- --:--:-- --:--:-- 2027k
==> Validating source files with md5sums...
    tauon-music-box-6.8.0.tar.gz ... Passed
 -> python-natsort not satisfied, flushing install queue
==> Making package: tauon-music-box 6.8.0-1 (Tue 19 Oct 2021 09:39:12 AM EDT)
==> Checking runtime dependencies...
==> Checking buildtime dependencies...
==> Retrieving sources...
  -> Found tauon-music-box-6.8.0.tar.gz
==> Validating source files with md5sums...
    tauon-music-box-6.8.0.tar.gz ... Passed
==> Removing existing $srcdir/ directory...
==> Extracting sources...
  -> Extracting tauon-music-box-6.8.0.tar.gz with bsdtar
==> Sources are ready.
==> Making package: tauon-music-box 6.8.0-1 (Tue 19 Oct 2021 09:39:14 AM EDT)
==> Checking runtime dependencies...
==> Checking buildtime dependencies...
==> WARNING: Using existing $srcdir/ tree
==> Starting build()...
Compiled: sv
Compiled: pt
Compiled: es
Compiled: pt_PT
Compiled: id
Compiled: pt_BR
Compiled: nb_NO
Compiled: ru
Compiled: ja_JP
Compiled: de
Compiled: fr_FR
Compiled: zh_CN
Done
==> Entering fakeroot environment...
==> Starting package()...
==> Tidying install...
  -> Removing libtool files...
  -> Purging unwanted files...
  -> Removing static library files...
  -> Stripping unneeded symbols from binaries and libraries...
  -> Compressing man and info pages...
==> Checking for packaging issues...
==> Creating package "tauon-music-box"...
  -> Generating .PKGINFO file...
  -> Generating .BUILDINFO file...
  -> Generating .MTREE file...
  -> Compressing package...
==> Leaving fakeroot environment.
==> Finished making: tauon-music-box 6.8.0-1 (Tue 19 Oct 2021 09:39:18 AM EDT)
==> Cleaning up...
loading packages...
resolving dependencies...
looking for conflicting packages...

Package (1)      Old Version  New Version  Net Change

tauon-music-box  6.7.1-1      6.8.0-1        0.07 MiB

Total Installed Size:  2.83 MiB
Net Upgrade Size:      0.07 MiB

:: Proceed with installation? [Y/n] 
(1/1) checking keys in keyring                     [-----------------------] 100%
(1/1) checking package integrity                   [-----------------------] 100%
(1/1) loading package files                        [-----------------------] 100%
(1/1) checking for file conflicts                  [-----------------------] 100%
(1/1) checking available disk space                [-----------------------] 100%
:: Processing package changes...
(1/1) upgrading tauon-music-box                    [-----------------------] 100%
:: Running post-transaction hooks...
(1/4) Arming ConditionNeedsUpdate...
(2/4) Updating icon theme caches...
(3/4) Checking which packages need to be rebuilt
(4/4) Updating the desktop file MIME type cache...
[scott@endeavourOS ~]$ yay
:: Synchronizing package databases...
 core is up to date
 extra is up to date
 community is up to date
 multilib is up to date
 endeavouros is up to date
:: Starting full system upgrade...
 there is nothing to do
:: Searching databases for updates...
:: Searching AUR for updates...
 -> Missing AUR Packages:  python-sgmllib
 -> Flagged Out Of Date AUR Packages:  gdm-prime  libgdm-prime
 there is nothing to do
[scott@endeavourOS ~]$

Below is the output for when I removed python-sgmllib:

[scott@endeavourOS ~]$ sudo pacman -Rc python-sgmllib
[sudo] password for scott: 
checking dependencies...

Package (1)     Old Version  Net Change

python-sgmllib  5.2.1-9       -0.03 MiB

Total Removed Size:  0.03 MiB

:: Do you want to remove these packages? [Y/n] 
:: Processing package changes...
(1/1) removing python-sgmllib                      [-----------------------] 100%
:: Running post-transaction hooks...
(1/1) Arming ConditionNeedsUpdate...
[scott@endeavourOS ~]$ yay
:: Synchronizing package databases...
 core is up to date
 extra is up to date
 community is up to date
 multilib is up to date
 endeavouros is up to date
:: Starting full system upgrade...
 there is nothing to do
:: Searching databases for updates...
:: Searching AUR for updates...
 -> Flagged Out Of Date AUR Packages:  gdm-prime  libgdm-prime
 there is nothing to do
[scott@endeavourOS ~]$

Stagger_Lee · October 19, 2021, 6:14pm

pacman -Qi packagename will show info about an installed package, including dependencies and if it is required by another package,

You could have run pacman -Qi python-sgmllib to determine if the package was needed by another package.

In this case, the package was probably installed as a dependency of python-feedparser; it was removed as a dependency of this package just a few hours ago.

See line #43 here:

manuel · October 19, 2021, 6:33pm

Has it been renamed or removed?

yay -Ss python sgmllib

Also the suggested command pacman -Qi python-sgmllib may show useful information. If you already uninstalled it, it may still be in your package cache, then you could reinstall it.

Stagger_Lee · October 19, 2021, 6:39pm

It seems it has been removed. It was maintained by the same individual who maintained python-feedparser, which had it as a dependency; it was an old package, and the feedparser dev had already talked about wanting to move away from it. See his reply in this discussion from June:

github.com/kurtmckee/feedparser

sgmllib3k which is one of the dependencies, is deprecated

opened 02:45AM - 02 Jun 21 UTC

closed 01:59PM - 13 Jun 21 UTC

gridhead

On installing `feedparser` in a virtual environment, I ran into the versioning o…f one of the dependencies called `sgmllib3k` which I deduced to be strange (v1.0.0). ![image](https://user-images.githubusercontent.com/49605954/120415967-07401a00-c37a-11eb-8342-9e8e84928305.png) On searching for the said dependencies, I came across this page. ![image](https://user-images.githubusercontent.com/49605954/120416049-263eac00-c37a-11eb-9260-af0e4ed22182.png) The author says to have made a "quick and dirty" port to Python 3 and states that it would no longer be maintained by them. With that, I have a couple of questions/concerns - 1. Should the fact that `sgmllib3k` has not had a new version for 11 years and that their homepage http://hg.hardcoded.net/sgmllib gives a 404, be concerning to this project and its users? 2. Are there any attempts made to make a shift towards a similar alternative library that is actively maintained and if so, is there a roadmap for the port to happen?

sgmllib was part of the Python 2 standard library and it was extracted as the sgmllib3k module and put on pip during the transition to Python 3. It’s not an ideal dependency anymore…

It’s a goal to move off of sgmllib, but I don’t have months of free time like I did back in 2010…

It looks like he finally managed to find the time to do so.

EDIT - BTW, using the Wayback Machine to view an archived copy of the page for python-sgmllib, you can see it had only python-feedparser listed as requiring it.

fbodymechanic · October 19, 2021, 6:56pm

Also, I don’t know about others, but I usually don’t remove with the -c flag. Cascade scares me. I normally remove things with -Rs.

Scotty_Trees · October 19, 2021, 11:06pm

Thanks very much everyone for the help, very much appreciated! That definitely clears it up! It has been removed and no issues to report, so all is well in the EndeavourOS world

Scotty_Trees · October 20, 2021, 4:58pm

Just a quick follow up, python-feedparser got an update today and pulled in the dependency python-sgmllib3k so I guess it looks like they swapped from using the older python-sgmllib dependency to the python-sgmllib3k package. No issues to report, everything still seems to be in working order, just some “re-structuring” underneath the hood so to speak

[scott@endeavourOS ~]$ yay
[sudo] password for scott: 
:: Synchronizing package databases...
 core is up to date
 extra                1570.0 KiB   287 KiB/s 00:05 [-----------------------] 100%
 community               5.8 MiB  1626 KiB/s 00:04 [-----------------------] 100%
 multilib is up to date
 endeavouros is up to date
:: Starting full system upgrade...
resolving dependencies...
looking for conflicting packages...

Package (2)              Old Version  New Version  Net Change  Download Size

extra/python-feedparser  6.0.1-1      6.0.1-2        0.00 MiB       0.10 MiB
extra/python-sgmllib3k                1.0.0-1        0.04 MiB       0.01 MiB

Total Download Size:   0.12 MiB
Total Installed Size:  0.61 MiB
Net Upgrade Size:      0.04 MiB

:: Proceed with installation? [Y/n] 
:: Retrieving packages...
 python-sgmllib3k...    12.8 KiB  64.9 KiB/s 00:00 [-----------------------] 100%
 python-feedparse...   106.2 KiB   286 KiB/s 00:00 [-----------------------] 100%
 Total (2/2)           119.0 KiB   281 KiB/s 00:00 [-----------------------] 100%
(2/2) checking keys in keyring                     [-----------------------] 100%
(2/2) checking package integrity                   [-----------------------] 100%
(2/2) loading package files                        [-----------------------] 100%
(2/2) checking for file conflicts                  [-----------------------] 100%
(2/2) checking available disk space                [-----------------------] 100%
:: Processing package changes...
(1/2) installing python-sgmllib3k                  [-----------------------] 100%
(2/2) upgrading python-feedparser                  [-----------------------] 100%
:: Running post-transaction hooks...
(1/2) Arming ConditionNeedsUpdate...
(2/2) Checking which packages need to be rebuilt
:: Searching databases for updates...
:: Searching AUR for updates...
 -> Flagged Out Of Date AUR Packages:  gdm-prime  libgdm-prime
 there is nothing to do
[scott@endeavourOS ~]$

@Bryanpwo I’ve only run yay twice today just so you are aware…but the day is not over yet! Might need to see about having some “I update hourly/I update daily/I update only on full moons” badges or something

EDIT: In my first comment, I mentioned that sgmllib3k was in the AUR, but after today’s update, you can see that the package has now made it’s way into the Arch Extra repos.

system · October 22, 2021, 4:59pm

This topic was automatically closed 2 days after the last reply. New replies are no longer allowed.