Commit Graph

363 Commits

Author SHA1 Message Date
lxnay
88c514f51c Entropy/entropyConstants:
- split const_HandleException creating const_kill_threads
Entropy/entropyTools:
- kill_threads uses const_kill_threads
- introduce movefile(), from Portage, that will be used to atomically move files


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3007 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-10 16:15:19 +00:00
lxnay
33caba6c93 Entropy/Equo:
- kill all stale threads the hard way when an exception occured
Entropy/Spritz:
- same as above


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2967 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-01-30 08:14:41 +00:00
lxnay
343bd0835f Entropy/ServerInterface:
- when downloading a remote db revision file, check if the download itself went fine
Entropy/SystemManagerExecutorServerRepositoryInterface:
- remove some debugging output


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2935 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-01-20 19:41:22 +00:00
lxnay
66972dd778 Entropy/entropyTools:
- lifobuffer: improve reliability

git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2917 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-01-16 21:14:20 +00:00
lxnay
4bf5d1d093 Entropy/entropyTools:
- add two new methods to convert dictionaries to XML and vice versa: xml_from_dict_extended, dict_from_xml_extended


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2868 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-01-08 15:56:43 +00:00
lxnay
98ed3fdc07 Entropy/entropyTools:
- TimeScheduled: add set_delay method
- TimeScheduled: remove try/except from do_delay, no longer needed
- lifobuffer: improve speed, add method clear and make it multithreading aware


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2858 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-01-06 18:48:56 +00:00
lxnay
074bd3d9aa Entropy/entropyTools:
- some optimizations to the elf metadata reading/parsing functions
- new function read_elf_broken_symbols
Entropy/QAInterface:
- libraries_test: implement broken symbols check, optional
Entropy/ServerInterface:
- always enable broken symbols check on libtest


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2830 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-01-02 13:10:57 +00:00
lxnay
ff606ff438 Entropy/entropyTools:
- bye bye old uncompressTarBz2 function


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2823 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-01-01 17:31:10 +00:00
lxnay
93176ad2ca Entropy/entropyTools:
- applicationLockCheck: raise SystemExit exception instead of sys.exit
Entropy/EquoInterface:
- changed dependencies calculation results, always pull in updated dependencies, deep_deps now works with revisions, disabled 'needed' check
Entropy/entropyConstants:
- fix a small bug in const_setupEntropyPid: that caused to report entropy as locked if entropy.pid is found but empty


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2819 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-12-31 08:33:18 +00:00
lxnay
4bf56a99c3 Entropy/TODO:
- update TODO
Entropy/entropyConstants:
- say goodbye to etpRSSMessages
- other cosmetical fixes
Entropy/EquoInterface:
- close LogFile instance's file on instance delete
- wipe os.system() calls
- rewrite get_meant_packages() to use SOUNDEX features of SQLITE3
- replace old and slow filterSatisfiedDependencies with get_unsatisfied_dependencies, which is faster and more reliable (added NEEDED check by default)
- improve speed of generate_dependency_tree
- improve speed of get_required_packages
- fix get_world_update_cache_hash()
- improve speed of retrieveInstallQueue
- make __unpack_package reporting the right error on uncompressTarBz2 if this crashes
- remove Python 2.4/2.5 workarounds since they are not needed anymore, being entropyTools.uncompressTarBz2 fixed forever (handling UTF-8 filenames correctly)
- adjust __move_image_to_system for the changes above
- __move_image_to_system, if an error is caught on shutil.move, do not crash but report it to user instead
Entropy/TriggerInterface:
- replace os.system() with subprocess.call()
- remove unused nspluginwrapper trigger
Entropy/ErrorReportInterface:
- add locale output
- get the full content of ps auxf, not just the first 80 chars
- update handler accordingly (handlers/)
Entropy/LogFile:
- close log file on object deletion
Entropy:
- import subprocess by default
Entropy/EntropyDatabaseInterface:
- remove etpRSSMessages and use a ServerInterface variable instead
- add new method getVersioningData, useful to speed up other Entropy areas
- improving speed of other functions adding more one-liners conditionals
- add new method retrieveNeededRaw, useful to speed up other Entropy areas
- improve speed of retrieveDependenciesList, everything can be done at SQL level
- new method searchSimilarPackages that uses SOUNDEX to retrieve similar package/atom names
- improve speed of listAllCategories
- shrink databaseStructureUpdates
- remove old and dusted method
- improve speed of doDatabaseImport
- improve speed of database_checksum
- group multiple .cursor.execute using .cursor.executescript
- improve speed of __filterSlotTagUse
Entropy/entropyTools:
- improve speed and reliability of uncompressTarBz2


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2818 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-12-30 18:43:16 +00:00
lxnay
5337fdec11 Entropy/caches:
- remove cache global variables
- say goodbye to const_resetCache, not needed anymore


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2783 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-12-14 13:23:52 +00:00
lxnay
47c6252dc1 Entropy/TimeScheduled:
- make possible to sleep before spawning the function
Entropy/EquoInterface:
- packageSetMatch: return empty tuple if no matches are found (instead of empty dict) when multiMatch is not enabled
- generate_dependency_tree(): add flat option, to return a yet ordered dependencies list (instead of a dict)
- generate_dependency_tree(): slightly update speed when creating the final dictionary
Entropy/phpBB3AuthInterface:
- make possible to disable the update of the session table
Entropy/UGCCacheInterface:
- get_package_downloads(): always return int


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2744 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-12-09 13:12:31 +00:00
lxnay
6f7cd190e9 Entropy/entropyTools:
- add extract_packages_from_set_file method, just a helper function
Entropy/Package Masking inteface reworked:
- etpConst['packagemasking'] is gone, the Package masking interface changed name, now it's called PackageSettings and is a standalone class that can work like a simple python dictionary object
- adapt all the code to the new interface, which is close to final and pretty solid if compared to the old one etpConst['packagemasking'] dict and its issues (like being un-initialized)
Entropy/Package sets support:
- implement server-side methods (ServerInterface) to collect repository-defined sets
Entropy/urlFetcher:
- move some init code to stand-alone functions (setup_proxy and setup_resume_support method)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2733 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-12-07 19:28:05 +00:00
lxnay
7ace4938ce Entropy/entropyTools:
- uncompressTarBz2: fix typo

git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2700 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-11-21 14:38:33 +00:00
lxnay
5e89bd7ce4 Entropy/entropyTools:
- improve uncompressTarBz2

git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2699 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-11-21 09:10:20 +00:00
lxnay
d304069ae9 Entropy/entropyTools:
- create generic functions to ease entropy package atom and filename strings creation


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2662 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-11-09 19:32:55 +00:00
lxnay
f6c7cb49e0 Entropy/EquoInterface:
- split extract_pkg_metadata(): cross fingers, needs testing
Entropy/entropyTools:
- add sum_file_sizes function


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2660 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-11-09 17:38:21 +00:00
lxnay
9d21894af9 Entropy/DistributionUGCInterface:
- add search_iddoc_item method to search available document identifiers
Entropy/RepoInterface:
- implement system make.conf sanity check
- implement automatic /etc/make.profile updates
Entropy/entropyConstants:
- add rootdir prefix to spm configuration files
Entropy/entropy.py:
- general tidy
Entropy/entropyTools:
- add function to determine if a path is sane or not (is_valid_path)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2658 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-11-09 16:06:20 +00:00
lxnay
aa7eebdf2a Entropy:
- we are now >=Python2.5 only, sorry 2.4


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2602 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-31 21:23:00 +00:00
lxnay
3583fa67d6 Entropy/entropyTools:
- uncompressTarBz2(): catch EOFError exceptions and return -1
Entropy/PackageInterface:
- __unpack_package(): when running fetch_step, check if returns 0
- try to unpack the package 3 times before giving up, if it fails, try to redownload it again


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2589 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-29 13:05:41 +00:00
lxnay
c57e70f332 Entropy/entropyTools:
- getRandomNumber(): use os.urandom()
- dep_getkey(): check if input param is valid


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2579 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-28 11:28:17 +00:00
lxnay
935f5903fa Entropy/entropyTools:
- add helper functions is_valid_ascii() and is_valid_unicode()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2559 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-24 09:57:00 +00:00
lxnay
ab4d586b9f Entropy/phpBB3AuthInterface:
- add valid password range
- add valid username range
Entropy/EAPI3/Client:
- do not crash if repository, arch or product are None (while converting to coloured output) in convert_stream_to_object()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2543 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-23 12:01:48 +00:00
lxnay
1dc14f2dca Entropy/EquoInterface:
- implement safe mode feature -> EquoInterface.safe_mode status integer, first function to use it is EquoInterface.openClientDatabase()
- openClientDatabase() make possible to start an EquoInterface instance with a corrupted/non-existant installed packages database (safe mode) which can be detected by client interfaces (Equo/Spritz)
Entropy/EntropyDatabaseInterface:
- improve branch support (and speed) for client database (installed packages db)
Entropy/rssFeed:
- make it a generic RSS handling class
Entropy/ServerInterface:
- make changes to rssFeed instances to reflect the change above
Entropy/Repository Manager:
- add support for notice boards handling
Entropy/ServerInterface:
- add support for notice boards handling
Entropy/EquoInterface:
- add support for notice boards


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2521 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-13 17:14:06 +00:00
lxnay
76d8d9596c Entropy/TODO:
- update TODO
Entropy/Equo:
- add installed packages database backup/restore tools
Entropy/EquoInterface:
- add backup/restore database helper functions
Entropy/EntropyDatabaseInterface:
- fix getIDPackageFromDownload()
Entropy/entropyTools:
- add compress_file() function (uncompress_file() already present)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2518 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-11 21:11:07 +00:00
lxnay
9347bd4f24 Entropy/entropyTools:
- spawnFunction(): add the ability to provide a callback function to read the child pid id
Entropy/Repository Manager:
- make possible to stop any queued command that calls spawnFunction (85% of them)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2515 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-10 20:22:16 +00:00
lxnay
b4e6609cf4 Entropy/FtpInterface:
- improve FTP uri parser, move to entropyTools
- fix issues when no directory path is specified


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2514 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-10 19:24:02 +00:00
lxnay
8553d11794 Entropy/entropyTools:
- improve remove_usedeps()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2482 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-06 17:43:08 +00:00
lxnay
25836b46b7 Entropy/entropyTools:
- add a function to truncate a file till its first newline char


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2450 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-03 01:56:42 +00:00
lxnay
149c1ca5a2 Entropy/Portage:
- add EAPI2 support (entropyTools)
Entropy/atomMatch:
- add support for matching USE flags and Portage EAPI2 syntax


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2445 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-30 11:41:33 +00:00
lxnay
6380f2d8ec Entropy/entropyTools:
- fix issues with xgettext


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2443 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-30 10:08:41 +00:00
lxnay
ab1a96446b Entropy/entropyTools:
- dict_from_xml(): make it working for empty strings


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2435 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-29 19:50:15 +00:00
lxnay
578b5080b1 Entropy/entropyTools:
- improve parallelTask class by storing the function result into self.result


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2416 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-24 13:17:17 +00:00
lxnay
836eadc822 Entropy/entropyTools:
- add functions useful to verify if a file is an image (supported png, jpeg, bmp, gif)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2402 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-18 08:49:07 +00:00
lxnay
046bcd66ee Entropy/entropyTools:
- parallelTask: make nuke() exception configurable


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2398 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-17 13:03:07 +00:00
lxnay
bc52cdeb02 Entropy/entropyTools:
- add kill method to parallelTask class


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2380 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-15 16:21:46 +00:00
lxnay
6e2bd52bb9 Entropy/entropyTools:
- removePackageOperators(): avoid crashing with malformed atom strings


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2315 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-07-31 08:29:08 +00:00
lxnay
5a4c0f83da Entropy/entropyTools:
- compareVersions() do not raise an exception when ver1 or ver2 are None


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2313 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-07-26 07:22:05 +00:00
lxnay
b79ea7d011 Entropy/entropyTools:
- xml_from_dict(): only support basestring
Entropy/DistributionUGCCommands:
- docmd_register_stream(): fix new_stream_path


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2312 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-07-25 13:43:05 +00:00
lxnay
8d25ac956a Entropy/entropyTools:
- added handy functions to stream a dict to xml and vice versa
Entropy/UGCClientInterface:
- break API in favour of a more scalable UGC handling (providing title, desc, keywords support to every document in database)
- reflect changes in UGC Server interface
- implement file send (untested yet)
Entropy/DistributionUGCCommands:
- implement streamed files handling
- API break, reflect changes in UGC Database interface
Entropy/DistributionUGCInterface:
- break SQL schema, add entropy_docs_keywords table
- update entropy_docs related methods to support keywords, title and description (the latter when needed)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2307 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-07-25 12:16:57 +00:00
lxnay
b571cdad66 Entropy/entropyTools:
- fix getRepositorySettings()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2253 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-07-06 17:22:50 +00:00
lxnay
1b03c09179 Entropy/SSL Services:
- add ssl_port parameter to etpRepositories, making it configurable
- update entropyTools.saveRepositorySettings() accordingly
Entropy/constants:
- add CA.crt and CA.key constants that will be used by the new SSL code in SocketHostInterface


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2215 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-07-02 12:51:49 +00:00
lxnay
fc989eab38 Entropy/PortageInterface:
- update USE flag handling to new schemas
Entropy/SocketHostInterface:
- update killall() to work better when killing threads
Entropy/Repository Interface:
- update killall() here too


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2190 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-30 07:49:59 +00:00
lxnay
d21d8f6db0 Entropy/RepositoryManager:
- first bunch of code implemented, using urwid library
- application name = Enzyme
Entropy/entropyTools:
- improved parallelTask(), make it use *args and **kwargs
- fixed code accordingly
- some new functions
Entropy/outputTools:
- make shell output function faster by reducing call time


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2179 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-24 13:22:14 +00:00
lxnay
ccaef70199 Entropy:
- move proxy initialization to entropyTools.add_proxy_opener()
- fix writeParameterToFile() when disabling items
EquoInterface:
- update proxy setup using entropyTools.add_proxy_opener()
- add support for _basic_ proxy username and password authentication
Entropy/Spritz:
- export proxy username and password settings


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2160 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-19 18:35:28 +00:00
lxnay
40427fec0c Entropy/FtpInterface:
- raise new exception FtpError on login issues
Entropy/exceptionTools:
- add FtpError exception class
Entropy/SocketHostInterface:
- spawn every command call in a different process to avoid Python to eat memory like cookies (and get fat like a pig)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2140 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-13 19:48:55 +00:00
lxnay
d09b55decd Entropy/RepoInterface:
- fix internet connection check


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2096 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-03 09:33:34 +00:00
lxnay
59d1f75019 Entropy/entropyTools:
- improve writeParameterToFile() by using regexps


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2092 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-03 00:29:13 +00:00
lxnay
36e568f247 Entropy:
- implement a new entropyTools function to write settings to config files: writeParameterToFile()
- some misc updates


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2079 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-02 09:09:38 +00:00
lxnay
74f54bce5c Entropy/UTF-8:
- fix entropyTools.countdown() to work with UTF-8

git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2076 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-06-01 16:40:17 +00:00