xtreemfs/CHANGELOG

12-MAR-2015: release 1.5.1

  Changes:
    * Hadoop Adapter supports Hadoop-2.x and other applications running on the YARN platform (tested with Apache Spark and Apache Flink), new OSD selection policy that imitates the HDFS placement behavior.
    * Consistent adding and removing replicas for R/W replication.
    * xtfs_scrup now replaces failed replicas using the R/W replication policy.
    * Improvements of the SSL mode: the used SSL/TLS version is selectable, strict certificate chain checks are possible, the SSL code on client and server side was improved.
    * Support for PKCS12 certificate containers is remove from the Windows client (did not work in previous release).
    * mount.xtreemfs accepts all parameters to be passed in the form -o option=value. If XtreemFS is mounted via /etc/fstab, mount options are passed to the XtreemFS client.
    * Dockerfiles for the XtreemFS services are available at https://github.com/xtreemfs/xtreemfs-docker.
    * A Vagrantfile is available in the XtreemFS repository to ease development and testing for new contributors.
    * Fixed snapshots in the case of deleted files.
    * Snapshots can be deleted even after inactivating snapshots for a volume (issue 290).
    * Initial version of an LD_PRELOAD based client that bypasses FUSE (experimental).
    * Initial implementation of volume quotas (checked only while opening files by the MRC).
    * OSDs can report their health to the DIR (e.g. based on SMART values), which aggregates this information in the web interface. A new OSD selection policy sorts out unhealthy OSDs.
    * Improved automatic testing: introduced Travis-CI, migrated all JUnit tests to version 4, improved reliability of nightly integration tests.
    * Added new benchmark tool xtfs_benchmark that is based on the JAVA libxtreemfs.
    * Many small improvements and fixes.

12-MAR-2014: release 1.5 (Wonderful Waffles)

  Changes:
    * Improved Hadoop Adapter e.g., added support for multiple volumes and read and write buffer to speed up performance.
    * Support for SSDs: Support for multiple OSD storage threads to increase parallelism.
    * Status webpage as part of the DIR webinterface for replicated files to show current primary and backup replicas.
    * Multi-homing support. XtreemFS can now be made available for multiple networks and clients will pick the correct address automatically.
    * Support for multiple OSDs per machine (e.g. one for each disk) through the xtreemfs-osd-farm init.d script.
    * Fixed major issues in Read-Only and Read/Write file replication.
    * Reduced metadata cache default timeout from 120 to 10 seconds. Disable it completely with --metadata-cache-size=0.
    * Upgraded to Google Protobuffers 2.5 which improves performance.
    * Windows Client: Fixed several issues (e.g., 286, 299) and updated the CbFS driver to the latest version.
    * XtreemFS also compiles under buildroot now.
    * Fixed several issues around SSL (e.g., 263, 281).
    * Fixed many small issues e.g., reported volume capacity was inaccurate (issue 296).
      Other fixed issues: 267, 268, 272, 274, 276, 277, 278, 283, 287, 288, 292, 293, 294.
    * Improved general stability (e.g., see issues 297, 301).
    * xtfs_scrub now repairs replicas with an invalid checksum automatically.
    * Disabled deferred deletion of file data on the OSDs.
    * Improved test coverage of nightly tests and added missing unit tests and a Valgrind leak check for C++ unit tests.

12-NOV-2012: release 1.4 (Salty Sticks)

  Changes:
    * Improved stability: Fixed client crashes when timeouts occurred; fixed server crashes and issues with the R/W replication.
    * Full support for asynchronous writes: If a client is started with "--enable-async-writes", write() requests will be immediately acknowledged by the client and executed in the background. Outstanding writes are always flushed at close() or fsync*() events. This improves the write throughput, especially in case of connections with high latency.
    * Added Windows Client Beta which uses Eldos' Callback File System product instead of Dokan.
    * Re-wrote HDFS interface implementation: Use XtreemFS as replacement for HDFS in your Hadoop setup.
    * libxtreemfs for Java: Access XtreemFS directly from your Java application. See source files org.xtreemfs.common.libxtreemfs.{Client,Volume,FileHandle}.java for the interface.
    * Re-added Vivaldi support and added/improved its functionality:
      * Vivaldi is directly integrated in the client now and can be enabled with '--vivaldi-enable'.
      * Added Vivaldi visualization: see '/vivaldi' subpage on DIR. Have a look at our demo server to get an impressium: http://demo.xtreemfs.org:30638/vivaldi
      * Coordinates of clients can be also visualized if clients reporting was enabled with '--vivaldi-enable-dir-updates'.
    * Added support for OSD Selection based on Custom Attributes. For example, assign a country code to every OSD as custom attribute and limit the placement of files on OSDs based on the attribute.

    * Rewrote xtfs_scrub tool and fixed support for read-only replicated files and checksums. R/W replicas will be supported in the next release.
    * Certificate password provided on command line no longer visible in process listing output. Additionally, the password can be entered on stdin now. (Issue 251)
    * Support for binary extended attributes (allows to preserve POSIX ACLs when copying data to XtreemFS; however they are not evaluated - use the XtreemFS ACLs therefore).
    * Fixed several client issues (e.g., 231, 234, 237).
    * Fixed clock synchronization problems which impaired the DIR/MRC replication. This also fixed issue 236.
    * Client: Added DIR fail over support. Specify multiple DIR replicas when mounting as follows: mount.xtreemfs dir1,dir2,dir3/volume. However, please note that the DIR/MRC replication is still experimental and not officially supported yet.
    * MacOSX Client: Fixed wrong df output (issue 247). Fixed failed installer if XtreemFS is already installed (issue 239). Fixed installer check if FUSE is installed (also works for OSXFUSE now) (issue 197).
    * Volume Snapshots Tools: Functionality was moved from "xtfs_snap" tool to "xtfsutil".
    * Various minor fixes.

    * MRC: To prevent confusion, global policy attributes are no longer allowed and always have to be prefixed by the policy id e.g., "1002.uuids".
    * init.d scripts no longer store a lock file in /var/lock/subsys. You can remove this directory now.

03-NOV-2011: release 1.3.1
    * Added 'xtfs_remove_osd' utility to remove OSDs from an XtreemFS installation. All files on the OSD to be removed will be relocated to different OSDs.
    * Added first support for asynchronous writes in the client. Mounting with '--max-writeahead' and '--max-writeahead-requests' allows the user to specify the maximum number of bytes and requests to be sent to an OSD before receiving an acknowledgment. However, this feature currently does not work together with replication and retries.
    * Added monitoring support to servers. Various characteristics are accessible now via SNMP, such as data transfer statistics, memory usage, numbers of files and directories, etc. A Ganglia plugin makes it possible to visualize them.
    * improved stability of MRC/DIR replication
    * improved the behavior of the read-write replication under heavy load by internally limiting the length of request queues
    * made several usability changes to xtfsutil
    * added '/babudb' subpage to MRC/DIR status page that shows internal database statistics
    * added Gentoo overlay
    * installing XtreemFS now creates symlinks '/sbin/mount.xtreemfs' and '/sbin/umount.xtreemfs' in order to support XtreemFS mounting via fstab (however, not all client options are available in the fstab yet, see issue 205)
    * the replication policy "WaRa" was renamed to "WaR1"
    * fixed issues 196, 198-204, 206-209, 211-218, 220, 222
    * fixed a wide range of issues w/ read-only and read-write replication of files
    * fixed issues w/ several MRC calls when admin passwords were specified (a consequence of this is that an XtreemFS 1.3.0 client can no longer mount admin_password protected MRCs; upgrade the client to 1.3.1 to fix this)
    * fixed various client issues, such as deadlocks and memory leaks

10-AUG-2011: release 1.3.0 (Tasty Tartlet)
    * added new features: full read-write replication of files, snapshots
    * completely re-wrote the client
      - it now supports metadata caching and automatic fail-over for replicated files
      - a client library 'libxtreemfs' separates the client logic from platform-specific bindings (e.g. FUSE, Dokan)
    * added first prototypes of metadata (MRC and DIR) replication
    * merged all user tools into a new general-purpose tool 'xtfsutil'
    * changed license from GPL to BSD