Commit Graph

1556 Commits

Author SHA1 Message Date
lxnay
0b3e6e55ed Entropy/Repository Manager:
- add digest verification functions
- use TimeScheduled for the connection killer handler instead of a horrible while loop
- kill all the connection on class deletion
M3 is DONE!


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2454 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-03 13:12:33 +00:00
lxnay
c8f6fb0e60 Entropy/System Manager:
- cache socket connection to improve speed
- add extended_result keyword inside queue items metadata to redirect big results there and avoid to have remote get_queue() taking a lot due to the need to serialize big data
- complete 'reagent' part
- implemented most of the 'activator' functions


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2452 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-03 01:59:47 +00:00
lxnay
ccdd7aec7f Entropy/entropyConstants:
- switch branch to 4 by default in hard-coded config


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2451 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-03 01:57:22 +00:00
lxnay
25836b46b7 Entropy/entropyTools:
- add a function to truncate a file till its first newline char


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2450 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-10-03 01:56:42 +00:00
lxnay
98b84340df Entropy/EquoInterface:
- openMemoryDatabase(): new function to open an empty Entropy database on RAM
Entropy/ServerInterface:
- get_available_repositories(): helper function to retrieve the list of available server-side repositories
- switch_default_repository(): make uninitialized repository handling optional
- openServerDatabase(): add do_cache parameter, make database classes caching optional
Entropy/Repository Manager:
- remote database management is almost complete, NLnet M3 @ 95% !
Entropy/EntropyDatabaseInterface:
- make it working on multiple, different threads
- add a thread lock (WriteLock) to handle multiple writes correctly
- removePackage(): make it looking better


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2446 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-30 21:42:42 +00:00
lxnay
149c1ca5a2 Entropy/Portage:
- add EAPI2 support (entropyTools)
Entropy/atomMatch:
- add support for matching USE flags and Portage EAPI2 syntax


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2445 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-30 11:41:33 +00:00
lxnay
50da03d02a Entropy/RepositoryManager:
- add --fetchonly and --buildonly support to compile_atoms()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2444 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-30 10:09:06 +00:00
lxnay
6380f2d8ec Entropy/entropyTools:
- fix issues with xgettext


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2443 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-30 10:08:41 +00:00
lxnay
de565dace8 Entropy/SystemManagerServerInterface:
- split queue processor in two, for items that can be run in parallel and others that cannot


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2440 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-29 21:18:40 +00:00
lxnay
f5a91e61a9 Entropy/RepositoryManager:
- goodbye old one, hope to not read you soon (:P)
Entropy/UGCCacheInterface:
- use thread locks instead of a simple bool, safer
Entropy/EntropyDatabaseInterface:
- createCountersIndex(): remove duplicated method, merge into one
Entropy/SystemManagerRepositoryMethodsInterface:
- implement a LOT of new methods
- SPM part completed
Entropy/SystemManagerMethodsInterface:
- add pinboard handling support
Entropy/SystemManagerRepositoryClientCommands:
- implement all the basic SPM command
Entropy/SystemManagerServerInterface:
- use thread locks for the queue data
- improve speed by reworking QueueManager data structure
- update functions accordingly
- add pinboard support
Entropy/SystemManagerExecutorServerRepositoryInterface:
- complete SPM support
Entropy/PortageInterface:
- add list_glsa_packages() method
- add get_glsa_id_information() method
- rework get_best_masked_atom() method
- rework get_category_description_data()
- rework get_atoms_in_system()
- rework get_atom_category()
- add get_installed_package_description()
- add get_package_slot()
- add get_package_useflags()
- add get_installed_package_useflags()
- add get_installed_package_setting()
Entropy/SocketHostInterface:
- make it leaking less


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2437 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-29 20:00:59 +00:00
lxnay
e5be4c8a93 Entropy/entropyConstants:
- add some SPM options for future reference


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2436 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-29 19:50:47 +00:00
lxnay
ab1a96446b Entropy/entropyTools:
- dict_from_xml(): make it working for empty strings


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2435 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-29 19:50:15 +00:00
lxnay
3f849ffb5f Entropy/PortageInterface:
- complete enable_package_useflags() and disable_package_useflags()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2433 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-26 09:29:37 +00:00
lxnay
716f06c3a2 Entropy/DatabaseInterface:
- insertCounter(): improve SQL syntax on DELETE


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2432 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-26 08:16:39 +00:00
lxnay
d91aa20e27 Entropy/Database Interface:
- insertCounter(): when running DELETE, also consider the branch


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2431 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-26 08:14:53 +00:00
lxnay
b85d9e1361 Entropy/ServerInterface:
- openServerDatabase(): hopefully fix counters table migration definitely


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2430 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 18:10:12 +00:00
lxnay
4a3d4eeff6 Entropy/ServerInterface:
- openServerDatabase(): force read-write hard !


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2429 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 17:54:02 +00:00
lxnay
d18b7b5322 Entropy/ServerInterface:
- openServerDatabase(): force a commit when migrating counters even if it is opened read-only


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2428 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 17:46:01 +00:00
lxnay
3cd5c0811d Entropy/EquoInterface:
- improve openRepositoryDatabase() reliability by considering the thread identifier when using its cache
Entropy/ServerInterface:
- do the same as above for the server database
- copy counters across branches only if the db is opened rw


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2427 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 17:43:18 +00:00
lxnay
4363f805ab Entropy/ServerInterface/Database Interface:
- code optimization when using SQLite executemany()
- change counters table structure (auto-migrated) to allow multiple branches support to work server-side, this shouldn't affect other things that much, hopefully


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2426 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 17:11:10 +00:00
lxnay
7c47ae9908 Entropy/ServerInterface:
- fix an issue with showing download paths


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2425 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 12:50:03 +00:00
lxnay
e6ee69c7ea Entropy/ServerInterface:
- show branch in the main info header


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2424 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 12:47:07 +00:00
lxnay
f864a22557 Entropy/UGC Interface:
- fix stream transfer and store


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2423 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 12:28:28 +00:00
lxnay
c49de891f3 Entropy/EquoInterface:
- generate_dependency_tree(): avoid crashing if atom retrieval didn't work successfully
Entropy/UGC Interface:
- make file uploads automatically divided per package key
Entropy/SystemManager Interface (Repository Manager):
- add get_spm_category_updates command to retrieve Portage updates per category


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2422 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-25 12:20:08 +00:00
lxnay
c53af72eea Entropy/SystemManager Interface:
- first BIG (I mean BIIIIG) commit of the Socket and Queue based communication infrastructure between two peers
Entropy/EquoInterface:
- misc fixes and improvements, nothing to worry about
Entropy/RepositoryManager:
- based on the SystemManager, it's what is going to be used for the Community/Server-side Repository GUI


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2418 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-24 13:28:00 +00:00
lxnay
7f2078cfd7 Entropy/entropyConstants:
- add 'constants' support for the future repository notice board


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2417 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-24 13:18:07 +00:00
lxnay
578b5080b1 Entropy/entropyTools:
- improve parallelTask class by storing the function result into self.result


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2416 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-24 13:17:17 +00:00
lxnay
c43a7fd38f Entropy/outputTools:
- inputBox: add support for check and combo boxes


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2415 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-24 13:16:30 +00:00
lxnay
380f57b523 Entropy/DistributionUGCInterface:
- when inserting an image, verify that is really an image
- add flood control feature when inserting a document (comment, file, image, video...)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2403 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-18 08:50:57 +00:00
lxnay
836eadc822 Entropy/entropyTools:
- add functions useful to verify if a file is an image (supported png, jpeg, bmp, gif)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2402 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-18 08:49:07 +00:00
lxnay
046bcd66ee Entropy/entropyTools:
- parallelTask: make nuke() exception configurable


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2398 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-17 13:03:07 +00:00
lxnay
f464b54255 Entropy/UGCClientInterface:
- remove debugging output on send_document_autosense()
Entropy/UGCCacheInterface:
- add multithreading lock handling to clean_* functions
- add clear_cache() method
- improve alldocs cache handling


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2387 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-16 21:02:40 +00:00
lxnay
a093dc1734 Entropy/entropyConstants:
- add repoid key to etpConst['server_repositories']


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2386 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-16 20:59:57 +00:00
lxnay
051de39d8a Entropy/entropyConstants:
- add document types descriptions (singular form)


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2381 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-15 16:22:35 +00:00
lxnay
bc52cdeb02 Entropy/entropyTools:
- add kill method to parallelTask class


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2380 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-15 16:21:46 +00:00
lxnay
52a16c2f67 Entropy/outputTools:
- make readtext() plopping proper unicode strings

git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2379 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-15 16:21:09 +00:00
lxnay
9af2dd6de9 Entropy/UGCCacheInterface:
- add UGCClientInterface.get_docs() cache infrastructure
Entropy/Socket/OpenSSL:
- add SysCallError exception handling
Entropy/entropyConstants:
- add ugc types description


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2375 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-07 19:50:20 +00:00
lxnay
a9b49c4e91 Entropy/RepoInterface:
- fix a typo in ____construct_paths() and add 'profile.link' item
- run_sync(): remove self.Entropy.update_ugc_cache() call, not needed
Entropy/EquoInterface:
- loadRepositoryDatabase(): verify that repository id really exists
Entropy/DistributionUGCCommands:
- fix commands syntax
Entropy/UGCCacheInterface:
- support multi-threaded mode
- improve performance
- get_package_downloads(): return 0 instead of None in case of errors
- get_downloads_cache(), get_vote_cache(): check against pickle load exceptions


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2368 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-09-05 18:33:22 +00:00
lxnay
6f91fbdc5a Entropy/DistributionUGCInterface:
- get_ugc_alldownloads(): force values to int()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2366 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 15:20:30 +00:00
lxnay
703656912a Entropy/UGCCacheInterface:
- new general purpose UGC caching infrastructure to speed up iterations when no up-to-date data is needed
Entropy/UGCClientInterface:
- move every caching related function to the new UGCCacheInterface class
- add some caching stuff
- make is_repository_eapi3_aware() faster
Entropy/DistributionUGCInterface:
- fix an error inside the query of get_ugc_alldownloads()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2365 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 15:13:45 +00:00
lxnay
f62a9f87c2 Entropy/SSL:
- remove debugging output
- improve SSL support by ironing out its socket interface


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2364 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 12:20:42 +00:00
lxnay
76b85350f8 Entropy:
testing SSL on big transfers


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2363 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 11:48:20 +00:00
lxnay
bf0c175b9d Entropy:
testing SSL on big transfers


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2362 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 11:42:49 +00:00
lxnay
2082bce726 Entropy:
testing SSL on big transfers


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2361 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 11:39:12 +00:00
lxnay
1493014901 whoops
git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2360 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 11:04:55 +00:00
lxnay
7a023dd7d0 Entropy/SocketHostInterface:
- add some debugging code
- try to split stream into multiple chunks on transmit()


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2359 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 11:03:22 +00:00
lxnay
0695e72048 Entropy/SocketHostInterface:
- add support for noop string
- add some testing code


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2358 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 10:54:50 +00:00
lxnay
f34d98ca3c Entropy/SocketHostInterface:
- improve transmitter on SSL


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2357 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 10:37:32 +00:00
lxnay
0a4edd8b28 Entropy/SocketHostInterface:
- workaround pyOpenSSL bug on sendall, connection tends to die, use send
Entropy/UGCClientInterface:
- improve performance of ugc_get_allvotes() and ugc_get_alldownloads()
- fix a bug with the selection of the connection port when ssl_connection is disabled


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2356 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-31 10:22:28 +00:00
lxnay
6bbed4e2e3 Entropy/misc:
- cosmetic changes


git-svn-id: http://svn.sabayonlinux.org/projects/entropy/trunk@2350 cd1c1023-2f26-0410-ae45-c471fc1f0318
2008-08-27 20:37:35 +00:00