Merge pull request #39 from arcivanov/release_0.1.8

Add multi-package delete capabilities
arcivanov · Sep 20, 2024 · a5fc498 · a5fc498
2 parents 4b69a2b + 38a4300
commit a5fc498
Show file tree

Hide file tree

Showing 3 changed files with 368 additions and 116 deletions.
diff --git a/README.md b/README.md
@@ -38,15 +38,15 @@ Authentication with TOTP is supported.
 
 ```bash
 $ pypi-cleanup --help
-usage: pypi-cleanup [-h] [-u USERNAME] -p PACKAGE [-t URL] [-r PATTERNS | --leave-most-recent-only] [--query-only] [--do-it] [-y] [-d DAYS] [-v]
+usage: pypi-cleanup [-h] [-u USERNAME] -p PACKAGES [-t URL] [-r PATTERNS | --leave-most-recent-only] [--query-only] [--do-it] [--delete-project] [-y] [-d DAYS] [-v]
 
-PyPi Package Cleanup Utility v0.1.7.dev20240624230606
+PyPi Package Cleanup Utility v0.1.8
 
 options:
   -h, --help            show this help message and exit
   -u USERNAME, --username USERNAME
                         authentication username (default: None)
-  -p PACKAGE, --package PACKAGE
+  -p PACKAGES, --package PACKAGES
                         PyPI package name (default: None)
   -t URL, --host URL    PyPI <proto>://<host> prefix (default: https://pypi.org/)
   -r PATTERNS, --version-regex PATTERNS
@@ -55,32 +55,88 @@ options:
                         delete all releases except the *most recent* one, i.e. the one containing the most recently created files (default: False)
   --query-only          only queries and processes the package, no login required (default: False)
   --do-it               actually perform the destructive delete (default: False)
+  --delete-project      actually perform the destructive delete that will remove all versions of the project (default: False)
   -y, --yes             confirm extremely dangerous destructive delete (default: False)
   -d DAYS, --days DAYS  only delete releases **matching specified patterns** where all files are older than X days (default: 0)
   -v, --verbose         be verbose (default: 0)
 ```
 
+#### Query-Only Mode
+
+Query-only mode is a safe mode that simply displays all package versions matches and exits, without requiring authentication or removing safeties:
+
+```bash
+$ pypi-cleanup -p karellen-llvm-core -p karellen-llvm-clang -r '.*rc\d.*' --query-only
+INFO:root:Running in QUERY-ONLY mode
+INFO:root:Will use the following patterns [re.compile('.*rc\\d.*')] on package 'karellen-llvm-core'
+INFO:root:Found the following releases of package 'karellen-llvm-core' to delete:
+INFO:root: 19.1.0.0rc1.post62
+INFO:root: 19.1.0.0rc2
+INFO:root: 19.1.0.0rc2.post43
+INFO:root: 19.1.0.0rc2.post45
+INFO:root: 19.1.0.0rc2.post52
+INFO:root: 19.1.0.0rc2.post59
+INFO:root: 19.1.0.0rc2.post69
+INFO:root: 19.1.0.0rc3
+INFO:root: 19.1.0.0rc3.post12
+INFO:root: 19.1.0.0rc3.post50
+INFO:root: 19.1.0.0rc3.post53
+INFO:root: 19.1.0.0rc4
+INFO:root: 19.1.0.0rc4.post6
+INFO:root: 19.1.0.0rc4.post13
+INFO:root: 19.1.0.0rc4.post18
+INFO:root:Query-only mode - exiting
+```
+
 #### Regular Cleanup of Development Artifacts
+
+First without the `--do-it` confirmation, i.e. in DRY RUN mode, including authentication and getting as close as possible to deleting without actually doing it:
+
 ```bash
 $ pypi-cleanup -u arcivanov -p pybuilder
+INFO:root:Running in DRY RUN mode
+INFO:root:Will use the following patterns [re.compile('.*\\.dev\\d+$')] on package 'pybuilder'
+INFO:root:Found the following releases of package 'pybuilder' to delete:
+INFO:root: 0.13.13.dev20240604074936
+INFO:root: 0.13.14.dev20240814015648
+Password: 
+Authentication code: 933344
+INFO:root:Would be deleting 'pybuilder' version 0.13.13.dev20240604074936, but not doing it!
+INFO:root:Would be deleting 'pybuilder' version 0.13.14.dev20240814015648, but not doing it!
+```
+
+Now to actually delete the specificed packages
+```bash
+$ pypi-cleanup -u arcivanov -p pybuilder --do-it
+WARNING:root:!!! POSSIBLE DESTRUCTIVE OPERATION !!!
+INFO:root:Will use the following patterns [re.compile('.*\\.dev\\d+$')] on package 'pybuilder'
+INFO:root:Found the following releases of package 'pybuilder' to delete:
+INFO:root: 0.13.13.dev20240604074936
+INFO:root: 0.13.14.dev20240814015648
 Password: 
 Authentication code: 123456
-INFO:root:Deleting pybuilder version 0.12.3.dev20200421010849
-INFO:root:Deleted pybuilder version 0.12.3.dev20200421010849
-INFO:root:Deleting pybuilder version 0.12.3.dev20200421010857
-INFO:root:Deleted pybuilder version 0.12.3.dev20200421010857
+WARNING:root:!!! WILL ACTUALLY DELETE THINGS - LAST CHANCE TO CHANGE YOUR MIND !!!
+WARNING:root:Sleeping for 5 seconds - Ctrl-C to abort!
+INFO:root:Deleting 'pybuilder' version 0.13.13.dev20240604074936
+INFO:root:Deleted 'pybuilder' version 0.13.13.dev20240604074936
+INFO:root:Deleting 'pybuilder' version 0.13.14.dev20240814015648
+INFO:root:Deleted 'pybuilder' version 0.13.14.dev20240814015648
 ```
 
 #### Using Custom Regex Pattern
+
 ```bash
-$ pypi-cleanup -u arcivanov -p geventmp -r '.*\\.dev1$' 
+$ pypi-cleanup -u arcivanov -p geventmp -r '.*\\.dev1$'
 WARNING:root:
 WARNING:
         You're using custom patterns: [re.compile('.*\\\\.dev1$')].
         If you make a mistake in your patterns you can potentially wipe critical versions irrecoverably.
         Make sure to test your patterns before running the destructive cleanup.
         Once you're satisfied the patterns are correct re-run with `-y`/`--yes` to confirm you know what you're doing.
         Goodbye.
+```
+
+```bash
 $ pypi-cleanup -u arcivanov -p geventmp -r '.*\\.dev1$' -y
 Password:
 WARNING:root:RUNNING IN DRY-RUN MODE
@@ -91,24 +147,14 @@ INFO:root:Deleting geventmp version 0.0.1.dev1
 
 #### Deleting All Versions Except The Most Recent One
 
-```bash
-$ pypi-cleanup -p pypi-cleanup --leave-most-recent-only
-WARNING:root:
-WARNING:
-        You're trying to delete ALL versions of the package EXCEPT for the *most recent one*, i.e.
-        the one with the most recent (by the wall clock) files, disregarding the actual version numbers 
-        or versioning schemes!
+List all versions that are going to be deleted except for the most recent one:
 
-        You can potentially wipe critical versions irrecoverably.
-        Make sure this is what you really want before running the destructive cleanup.
-        Once you're sure you want to delete all versions except the most recent one,
-        re-run with `-y`/`--yes` to confirm you know what you're doing.
-        Goodbye.
-$ pypi-cleanup -p pypi-cleanup --leave-most-recent-only -y --query-only
-INFO:root:Running in DRY RUN mode
+```bash
+$ pypi-cleanup -p pypi-cleanup --leave-most-recent-only --query-only
+INFO:root:Running in QUERY-ONLY mode
 INFO:root:Will only leave the MOST RECENT version of the package 'pypi-cleanup'
-INFO:root:Leaving the MOST RECENT package version: 0.1.7.dev20240624221535 - 2024-06-24T22:15:52.778775+0000
-INFO:root:Found the following releases to delete:
+INFO:root:Leaving the MOST RECENT version for 'pypi-cleanup': 0.1.7 - 2024-06-25T05:53:47.930884+0000
+INFO:root:Found the following releases of package 'pypi-cleanup' to delete:
 INFO:root: 0.0.1
 INFO:root: 0.0.2
 INFO:root: 0.0.3
@@ -121,3 +167,185 @@ INFO:root: 0.1.5
 INFO:root: 0.1.6
 INFO:root:Query-only mode - exiting
 ```
+
+Proceeding with deletion of everything except the most recent version requires pulling safeties: 
+
+```bash
+$ pypi-cleanup -p pypi-cleanup --leave-most-recent-only
+WARNING:root:
+WARNING:
+        You're trying to delete ALL versions of the package EXCEPT for the *most recent one*, i.e.
+        the one with the most recent (by the wall clock) files, disregarding the actual version numbers
+        or versioning schemes!
+
+        You can potentially wipe critical versions irrecoverably.
+        Make sure this is what you really want before running the destructive cleanup.
+        Once you're sure you want to delete all versions except the most recent one,
+        re-run with `-y`/`--yes` to confirm you know what you're doing.
+        Goodbye.
+```
+
+#### Deleting Multiple Packages
+
+Specify multiple packages by adding additional `-p` arguments as follows:
+
+```bash
+$ pypi-cleanup -p karellen-llvm-core -p karellen-llvm-clang -p karellen-llvm-lldb -p karellen-llvm-toolchain-tools -r '.*rc\d.*' -y -u karellen --do-it
+WARNING:root:!!! POSSIBLE DESTRUCTIVE OPERATION !!!
+INFO:root:Will use the following patterns [re.compile('.*rc\\d.*')] on package 'karellen-llvm-core'
+INFO:root:Will use the following patterns [re.compile('.*rc\\d.*')] on package 'karellen-llvm-clang'
+INFO:root:Will use the following patterns [re.compile('.*rc\\d.*')] on package 'karellen-llvm-lldb'
+INFO:root:Will use the following patterns [re.compile('.*rc\\d.*')] on package 'karellen-llvm-toolchain-tools'
+INFO:root:Found the following releases of package 'karellen-llvm-core' to delete:
+INFO:root: 19.1.0.0rc1.post62
+INFO:root: 19.1.0.0rc2
+INFO:root: 19.1.0.0rc2.post43
+INFO:root: 19.1.0.0rc2.post45
+INFO:root: 19.1.0.0rc2.post52
+INFO:root: 19.1.0.0rc2.post59
+INFO:root: 19.1.0.0rc2.post69
+INFO:root: 19.1.0.0rc3
+INFO:root: 19.1.0.0rc3.post12
+INFO:root: 19.1.0.0rc3.post50
+INFO:root: 19.1.0.0rc3.post53
+INFO:root: 19.1.0.0rc4
+INFO:root: 19.1.0.0rc4.post6
+INFO:root: 19.1.0.0rc4.post13
+INFO:root: 19.1.0.0rc4.post18
+INFO:root:Found the following releases of package 'karellen-llvm-clang' to delete:
+INFO:root: 19.1.0.0rc1.post62
+INFO:root: 19.1.0.0rc2
+INFO:root: 19.1.0.0rc2.post43
+INFO:root: 19.1.0.0rc2.post45
+INFO:root: 19.1.0.0rc2.post52
+INFO:root: 19.1.0.0rc2.post59
+INFO:root: 19.1.0.0rc2.post69
+INFO:root: 19.1.0.0rc3
+INFO:root: 19.1.0.0rc3.post12
+INFO:root: 19.1.0.0rc3.post50
+INFO:root: 19.1.0.0rc3.post53
+INFO:root: 19.1.0.0rc4
+INFO:root: 19.1.0.0rc4.post6
+INFO:root: 19.1.0.0rc4.post13
+INFO:root: 19.1.0.0rc4.post18
+INFO:root:Found the following releases of package 'karellen-llvm-lldb' to delete:
+INFO:root: 19.1.0.0rc4.post6
+INFO:root: 19.1.0.0rc4.post13
+INFO:root: 19.1.0.0rc4.post18
+INFO:root:Found the following releases of package 'karellen-llvm-toolchain-tools' to delete:
+INFO:root: 19.1.0.0rc1.post62
+INFO:root: 19.1.0.0rc2
+INFO:root: 19.1.0.0rc2.post43
+INFO:root: 19.1.0.0rc2.post45
+INFO:root: 19.1.0.0rc2.post52
+INFO:root: 19.1.0.0rc2.post59
+INFO:root: 19.1.0.0rc2.post69
+INFO:root: 19.1.0.0rc3
+INFO:root: 19.1.0.0rc3.post12
+INFO:root: 19.1.0.0rc3.post50
+INFO:root: 19.1.0.0rc3.post53
+INFO:root: 19.1.0.0rc4
+INFO:root: 19.1.0.0rc4.post6
+INFO:root: 19.1.0.0rc4.post13
+INFO:root: 19.1.0.0rc4.post18
+Password: 
+Authentication code: 123456
+WARNING:root:!!! WILL ACTUALLY DELETE THINGS - LAST CHANCE TO CHANGE YOUR MIND !!!
+WARNING:root:Sleeping for 5 seconds - Ctrl-C to abort!
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc1.post62
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc1.post62
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc2
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc2
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc2.post43
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc2.post43
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc2.post45
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc2.post45
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc2.post52
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc2.post52
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc2.post59
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc2.post59
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc2.post69
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc2.post69
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc3
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc3
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc3.post12
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc3.post12
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc3.post50
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc3.post50
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc3.post53
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc3.post53
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc4
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc4
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc4.post6
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc4.post6
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc4.post13
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc4.post13
+INFO:root:Deleting 'karellen-llvm-core' version 19.1.0.0rc4.post18
+INFO:root:Deleted 'karellen-llvm-core' version 19.1.0.0rc4.post18
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc1.post62
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc1.post62
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc2
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc2
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc2.post43
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc2.post43
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc2.post45
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc2.post45
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc2.post52
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc2.post52
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc2.post59
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc2.post59
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc2.post69
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc2.post69
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc3
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc3
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc3.post12
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc3.post12
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc3.post50
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc3.post50
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc3.post53
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc3.post53
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc4
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc4
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc4.post6
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc4.post6
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc4.post13
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc4.post13
+INFO:root:Deleting 'karellen-llvm-clang' version 19.1.0.0rc4.post18
+INFO:root:Deleted 'karellen-llvm-clang' version 19.1.0.0rc4.post18
+INFO:root:Deleting 'karellen-llvm-lldb' version 19.1.0.0rc4.post6
+INFO:root:Deleted 'karellen-llvm-lldb' version 19.1.0.0rc4.post6
+INFO:root:Deleting 'karellen-llvm-lldb' version 19.1.0.0rc4.post13
+INFO:root:Deleted 'karellen-llvm-lldb' version 19.1.0.0rc4.post13
+INFO:root:Deleting 'karellen-llvm-lldb' version 19.1.0.0rc4.post18
+INFO:root:Deleted 'karellen-llvm-lldb' version 19.1.0.0rc4.post18
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc1.post62
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc1.post62
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post43
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post43
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post45
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post45
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post52
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post52
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post59
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post59
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post69
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc2.post69
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3.post12
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3.post12
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3.post50
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3.post50
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3.post53
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc3.post53
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4.post6
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4.post6
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4.post13
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4.post13
+INFO:root:Deleting 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4.post18
+INFO:root:Deleted 'karellen-llvm-toolchain-tools' version 19.1.0.0rc4.post18
+```
diff --git a/build.py b/build.py
@@ -28,7 +28,7 @@
 
 
 name = "pypi-cleanup"
-version = "0.1.8.dev"
+version = "0.1.8"
 summary = "PyPI Bulk Release Version Cleanup Utility"
 
 authors = [Author("Arcadiy Ivanov", "[email protected]")]