Commit Graph

1946 Commits

Author SHA1 Message Date
lxnay dcd2027eaa Entropy/TriggerInterface:
- fix Entropy bash based trigger sandbox interaction


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3103 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-03-03 12:19:41 +00:00
lxnay 3df27f7c18 Entropy/FtpInterface (usage):
- raise exceptionTools.ConnectionError when needed and catch it
Entropy/Spritz:
- Equo interface, check if progressLog variable exists


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3099 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-03-02 12:08:34 +00:00
lxnay 291b91eff3 Entropy/TODO:
- update TODO
Entropy/*:
- small code syntax update
Entropy/SystemSocketClientInterface:
- Python 2.6: remove deprecation warning, use ssl module if available and its wrap_socket function instead of socket.ssl


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3095 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-03-01 14:35:05 +00:00
lxnay e960e4afd5 Entropy/entropyTools:
- TimeScheduled: disable accuracy by default
Entropy/Spritz:
- better handle Repositories Updates UI refresh
Entropy/TODO:
- update TODO


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3090 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-03-01 12:48:27 +00:00
lxnay 85639ba42e Entropy/MultipleUrlFetcher:
- fix download average calculation
Entropy/PackageInterface:
- multi_fetch support: add some metadata to infoDict


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3085 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-03-01 11:21:10 +00:00
lxnay 349b164f7b Entropy/TODO:
- update TODO
Entropy/Spritz:
- wait for UGC to close cleanly
Entropy/entropyConstants:
- const_kill_threads: wait for threads to close cleanly
Entropy/MultipleUrlFetcher:
- beautify output
Entropy/EntropyCacher:
- on stop() wait for CacheWriter to close cleanly
Entropy/EquoInterface:
- fetch_files: minor updates and fixes
- fetch_files_on_mirrors: new method, that mimics the behaviour of fetch_file_on_mirrors but using MultipleUrlFetcher
- fetch_file_on_mirrors: some fixes
Entropy/PackageInterface:
- implement multi_fetch action
- match_checksum: update method adding arguments to ease code reuse
- new methods multi_match_checksum and multi_fetch_step
- new method multi_checksum_step


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3084 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-28 22:10:54 +00:00
lxnay 46d73df488 Entropy/MirrorStatusInterface:
- new class used by EquoInterface, move there some mirror management methods that were in EquoInterface
Entropy/EquoInterface:
- make use of the new MirrorStatusInterface class


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3083 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-28 13:11:52 +00:00
lxnay dc2539f591 Entropy/urlFetcher:
- new methods get_transfer_rate() and is_resumed()
Entropy/MultipleUrlFetcher:
- new methods get_transfer_rate(), get_average() and get_seconds_remaining()
- improved updateProgress method
Entropy/EquoInterface:
- new method fetch_files, similar to fetch_file


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3082 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-28 12:20:46 +00:00
lxnay dc1cf06794 Entropy/SystemSettings:
- now a singleton too, had to reimplement all dict methods since i didn't want to wrap nasty things around the new class
Entropy/*:
- some bug fixes


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3081 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-27 19:51:07 +00:00
lxnay 457778fd60 Entropy/*:
- EntropyCacher is singleton, which makes a lot of classes happy


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3080 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-27 18:09:57 +00:00
lxnay aefb63a7a3 Entropy/TODO:
- update TODO
Entropy/EquoInterface/ServerInterface:
- they are now singleton, which is a big leap ahead in terms of ease of use
Entropy/Equo/Server:
- text_query, server_query: adapt code to better with singleton EquoInterface/ServerInterface instances
Entropy/Spritz:
- EquoInterface is now singleton, no need to load a global variable
Entropy/urlFetcher:
- add thread_stop_func, speed_limit, OutputInterface parameters to ease behaviour customization
- rename __setup_proxy (private) to _setup_proxy
- add set_id method, useful for thread identification when running multiple instances of urlFetcher
- close() is now a private method
- added thread_stop_func handling, used to stop fetches from other threads
- commit() is now a private method
- add handle_statistics method, if reimplemented, it's handy for controlling dataflow from other threads
Entropy/entropy.py:
- remove some unused functions imported from outputTools
Entropy/EntropyCacher:
- EntropyCacher is now singleton too
Entropy/MultipleUrlFetcher:
- base class that mimics the behaviour of urlFetcher adding the support for multiple simultaneous downloads
Entropy/entropyTools:
- improve xml_from_dict_extended and dict_from_xml_extended functions (add support for None types)
Entropy/entropy.sh:
- pre-declare public functions (pkg_*)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3078 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-27 17:59:34 +00:00
lxnay 94b6aaa422 Entropy/TODO:
- update TODO
Entropy/TriggerInterface:
- complete implementation of bash-based triggers
Entropy/EntropyDatabaseInterface:
- optimize getPackageData and getTriggerInfo
- getTriggerInfo: also provide branch and etp_revision information


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3076 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-25 14:10:01 +00:00
lxnay 764cb47fd0 Entropy/entropyTools:
- force type casting on dict_from_xml_extended

git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3075 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-25 12:36:15 +00:00
lxnay b287f7c7b7 Entropy/entropyTools:
- fix dict_from_xml_extended method


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3074 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-25 12:24:40 +00:00
lxnay e7f1dc863e Entropy/TODO:
- update TODO
Entropy/TriggerInterface:
- add support for bash based triggers (preliminary and incomplete)
- provide bash based trigger example


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3073 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-24 21:21:45 +00:00
lxnay f89438f358 Entropy/TriggerInterface:
- syntax updates


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3072 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-23 23:14:09 +00:00
lxnay 40caacd0fb Entropy/entropyTools/*:
- new version of parallelTask, API changes, update every part of the code that uses it


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3071 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-23 22:56:54 +00:00
lxnay 14134e7007 Entropy/entropyTools/*:
- new version of TimeScheduled, API changes, update every part of the code that uses it


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3070 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-23 22:50:34 +00:00
lxnay f1a253e67d Entropy/EquoInterface:
- fetch_file_on_mirrors: when file is not found, do not dump data already downloaded


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3069 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-23 19:27:53 +00:00
lxnay 9fb936d189 Entropy/TODO:
- update TODO
Entropy/EquoInterface:
- fetch_file_on_mirrors: make sure it gives up when no mirrors remain and it is for cycling the last uri


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3067 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-23 18:44:25 +00:00
lxnay d7022d0d6a Entropy/EquoInterface:
- ease the handling of available packages cache


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3066 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-23 16:22:22 +00:00
lxnay 4629810b63 Entropy/urlFetcher:
- add a new error status "-4", meaning timeout error, move KeyboardInterrupt error code to -100
Entropy/EquoInterface:
- properly handle timeout errors without discarding data downloaded until then


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3061 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 19:46:52 +00:00
lxnay 68731000d2 Entropy/urlFetcher:
- download: when running in debug mode, print exceptions


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3060 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 19:17:37 +00:00
lxnay 183e33e996 Entropy/EquoInterface:
- fetch_file: when running in debug mode, print the exception occured in urlFetcher, if any


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3059 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 19:03:27 +00:00
lxnay 2349b21596 Entropy/UGCClientInterface:
- ease add_download_stats, removing branch and release_string parameters
Entropy/RepositorySocketClientCommands:
- ugc_do_download_stats: make it automatically retreiving branch and release string


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3058 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 18:56:49 +00:00
lxnay 9a82bb2cd8 Entropy/DistributionUGCInterface:
- get_entropy_release_strings_id: fix another typo


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3057 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 18:37:26 +00:00
lxnay 3b81ecbacb Entropy/DistributionUGCInterface:
- fix do_download_stats, wrong variable reference


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3056 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 18:34:45 +00:00
lxnay 5f21d3d658 Entropy/DistributionUGCInterface:
- fix is_user_ip_available_in_entropy_distribution_usage SQL query


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3055 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 18:32:17 +00:00
lxnay 15b6f3e829 Entropy/TODO:
- update TODO
Entropy/urlFetcher:
- minor code style update
Entropy/EntropyCacher:
- rename Cacher to __cacher, making it a private method
- make critical variables private
Entropy/EquoInterface:
- get_unsatisfied_dependencies: improve speed, commenting out disabled code, add support for negative entropy revision on dependency strings, improve caching speed
- get_available_packages_chash: improve speed
- extract_pkg_metadata: kernel dependent packages now get the kernel dependency with revision == -1 (to force the installation of the very latest kernel revision)
Entropy/RepoInterface:
- handle_eapi3_database_sync: clear database cache before calling database_checksum
Entropy/DistributionUGCInterface:
- new tables entropy_distribution_usage, entropy_branches, entropy_release_strings, entropy_ip_locations, thus add support for Earth latitude, longitude mapping and detailed distribution usage stats
- add support for geo-tagging IP addresses (retrieving latitude, longitude)
- code style updates (long SQL queries on multiple rows)
- removed deprecated method do_download
- speed improvements of update_download
- a bunch of new methods, relevant one is do_download_stats (which is a more complex version of do_downloads)
Entropy/DistributionUGCCommands:
- removed support for ugc:do_download, deprecated
- added support for ugc:do_download_stats (see above)
Entropy/RepositorySocketClientCommands:
- added support for ugc_do_download_stats (see above)
- removed support for ugc_do_download (see above)
Entropy/UGCClientInterface:
- removed support for add_download (see above)
- added support for add_download_stats (see above)
Entropy/EntropyDatabaseInterface:
- database_checksum: cache result (through live_cache) to RAM
- atomMatch: filter out invalid atomRev values, < 0


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3054 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-22 18:05:03 +00:00
lxnay 8e61eee2f6 Entropy/urlFetcher:
- make internal methods private
- fix resume support when file is already completely downloaded


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3049 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-20 19:59:08 +00:00
lxnay 0c3ec7a16d Entropy/urlFetcher:
- fix resume support
Entropy/ut:
- trivial changes


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3048 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-20 19:48:12 +00:00
lxnay f1fe528c55 Entropy/entropyConstants:
- remove etpConst['packagestmpfile']
Entropy/entropyTools:
- getRandomNumber: if /dev/urandom is not available, fallback to random.randint
Entropy/*:
- when strictly required, if /dev/urandom is not available, fallback to random.randint


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3046 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-20 18:47:50 +00:00
lxnay 4865a100b8 Entropy/UT:
- fix urlFetcher test


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3045 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-19 16:15:20 +00:00
lxnay 20d5f806bf Entropy:
- add unit test dir


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3044 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-19 14:18:42 +00:00
lxnay 589b6408d5 Entropy/ServerInterface:
- package_injector: add manual dependencies notification
Entropy/EntropyDatabaseInterface:
- retrievePostDependencies, retrieveManualDependencies: use retrieveDependencies


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3040 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-17 14:00:47 +00:00
lxnay 87a711fe35 Entropy/TextInterface:
- inputBox: implemented support for list input items


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3039 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-17 13:46:33 +00:00
lxnay 0449b67878 Entropy/EquoInterface:
- _lookup_system_mask_repository_deps: tweak behaviour
- get_unsatisfied_dependencies: avoid issues with mapping types


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3038 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-17 11:59:40 +00:00
lxnay 8c555c7717 Entropy/EntropyDatabaseInterface:
- add support for manual dependencies on addPackage
- new handy method insertManualDependencies


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3037 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-17 01:01:09 +00:00
lxnay 683f43779e Entropy/entropyTools:
- new functions get_operator, catsplit, isvalidatom


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3036 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-17 00:57:41 +00:00
lxnay 9dbbb33eaa Entropy/EntropyDatabaseInterface:
- fix areIDPackagesAvailable method


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3035 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-16 18:27:22 +00:00
lxnay 81e95deb43 Entropy/SystemSettings:
- SystemSettings is now a dict subclass



git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3034 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-16 18:19:03 +00:00
lxnay 79b700261f Entropy/EntropyDatabaseInterface:
- reintroduce previously removed methods:
  listIdPackagesInIdcategory
  listIdpackageDependencies


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3032 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-16 12:45:56 +00:00
lxnay 29517ae14b Entropy/rssFeed:
- fix AttributeError exception when xml doesn't have any description tag


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3030 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-16 11:22:46 +00:00
lxnay 06e606f4d3 Entropy/TODO:
- update TODO
Entropy/rssFeed:
- fix AttributeError exception when xml doesn't have any description tag


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3029 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-16 11:19:51 +00:00
lxnay 918cbdcc21 Entropy/EntropyDatabaseInterface:
- query style update
- new method retrieveManualDependencies, will be implemented the support of manually set dependencies soon
- some other misc updates


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3028 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-15 22:06:20 +00:00
lxnay d041277cec Entropy/EntropyCacher:
- automatically copy data object on push(), there is no need to do weird things by caller anymore
Entropy/*:
- update EntropyCacher.push calls
Entropy/EquoInterface:
- atomMatch: add extra cache validation layer to make sure to not return crap
- atomMatch: improve speed by moving open_db function definition outside atomMatch


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3025 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-15 10:38:12 +00:00
lxnay d50eab4dd2 Entropy/EntropyDatabaseInterface:
- add atomMatchValidateCache on atomMatch which verifies if the cached is completely valid
- new method areIDPackagesAvailable
Entropy/RepoInterface:
- if EAPI3 sync fails (read: exceptions), remove the repository to avoid inconsistencies
- _construct_paths: use a dictionary-based index
Entropy/EquoInterface:
- validate EquoInterface.atomMatch results in generate_dependency_tree
Entropy/TODO:
- update TODO


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3023 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-15 00:04:47 +00:00
lxnay 998c692f7b Entropy/EntropyDatabaseInterface:
- remove several unused methods
Entropy/TODO:
- update TODO


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3018 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-11 20:45:26 +00:00
lxnay ec168afc1d Entropy/EquoInterface:
- rename some methods, we are entering in a final stabilization process
Entropy/TODO:
- update TODO


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3017 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-11 19:21:03 +00:00
lxnay 05adba8c37 Entropy/ServerInterface:
- add_packages_to_repository: did not respect repo parameter causing packages to be added to the wrong repository


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@3016 cd1c1023-2f26-0410-ae45-c471fc1f0318
2009-02-11 14:21:12 +00:00