diff --git a/INSTALL b/INSTALL index c40cb62b2..7f63c6835 100644 --- a/INSTALL +++ b/INSTALL @@ -1,861 +1,861 @@ Invenio INSTALLATION ==================== About ===== This document specifies how to build, customize, and install Invenio -v1.1.5 for the first time. See RELEASE-NOTES if you are upgrading +v1.2.0 for the first time. See RELEASE-NOTES if you are upgrading from a previous Invenio release. Contents ======== 0. Prerequisites 1. Quick instructions for the impatient Invenio admin 2. Detailed instructions for the patient Invenio admin 0. Prerequisites ================ Here is the software you need to have around before you start installing Invenio: a) Unix-like operating system. The main development and production platforms for Invenio at CERN are GNU/Linux distributions Debian, Gentoo, Scientific Linux (aka RHEL), Ubuntu, but we also develop on Mac OS X. Basically any Unix system supporting the software listed below should do. If you are using Debian GNU/Linux ``Lenny'' or later, then you can install most of the below-mentioned prerequisites and recommendations by running: $ sudo aptitude install python-dev apache2-mpm-prefork \ mysql-server mysql-client python-mysqldb \ python-4suite-xml python-simplejson python-xml \ gnuplot poppler-utils \ gs-common clisp gettext libapache2-mod-wsgi unzip \ python-dateutil python-rdflib python-pyparsing \ python-gnuplot python-magic pdftk html2text giflib-tools \ pstotext netpbm python-pypdf python-chardet python-lxml \ python-unidecode redis-server python-redis You may also want to install some of the following packages, if you have them available on your concrete architecture: $ sudo aptitude install sbcl cmucl pylint pychecker pyflakes \ python-profiler python-epydoc libapache2-mod-xsendfile \ openoffice.org python-utidylib python-beautifulsoup \ libhdf5-dev (Note that if you use pip to manage your Python dependencies instead of operating system packages, please see the section (d) below on how to use pip instead of aptitude.) Moreover, you should install some Message Transfer Agent (MTA) such as Postfix so that Invenio can email notification alerts or registration information to the end users, contact moderators and reviewers of submitted documents, inform administrators about various runtime system information, etc: $ sudo aptitude install postfix After running the above-quoted aptitude command(s), you can proceed to configuring your MySQL server instance (max_allowed_packet in my.cnf, see item 0b below) and then to installing the Invenio software package in the section 1 below. If you are using another operating system, then please continue reading the rest of this prerequisites section, and please consult our wiki pages for any concrete hints for your specific operating system. b) MySQL server (may be on a remote machine), and MySQL client (must be available locally too). MySQL versions 4.1 or 5.0 are supported. Please set the variable "max_allowed_packet" in your "my.cnf" init file to at least 4M. (For sites such as INSPIRE, having 1M records with 10M citer-citee pairs in its citation map, you may need to increase max_allowed_packet to 1G.) You may perhaps also want to run your MySQL server natively in UTF-8 mode by setting "default-character-set=utf8" in various parts of your "my.cnf" file, such as in the "[mysql]" part and elsewhere; but this is not really required. c) Redis server (may be on a remote machine) for user session management and caching purposes. By default, Invenio would use Redis to store sessions, so it is highly recommended to install it. However, if you do not want to use Redis, you can change CFG_WEBSESSION_STORAGE settings in invenio-local.conf and MySQL will be used for session management instead. d) Apache 2 server, with support for loading DSO modules, and optionally with SSL support for HTTPS-secure user authentication, and mod_xsendfile for off-loading file downloads away from Invenio processes to Apache. e) Python v2.6 or above: as well as the following Python modules: - (mandatory) MySQLdb (version >= 1.2.1_p2; see below) - (mandatory) Pyparsing, for document parsing - (mandatory) unidecode, for ASCII representation of Unicode text: - (recommended) Redis connector: - (recommended) Nydus, Redis consistent hashing connector: - (recommended) python-dateutil, for complex date processing: - (recommended) PyRXP, for very fast XML MARC processing: - (recommended) lxml, for XML/XLST processing: - (recommended) Gnuplot.Py, for producing graphs: - (recommended) Snowball Stemmer, for stemming: - (recommended) py-editdist, for record merging: - (recommended) numpy, for citerank methods: - (recommended) magic, for full-text file handling: - (recommended) cerberus, extensible validation for Python dictionaries. - (optional) libxml2-python, for XML/XLST processing: - (optional) chardet, for character encoding detection: - (optional) 4suite, slower alternative to PyRXP and libxml2-python: - (optional) feedparser, for web journal creation: - (optional) RDFLib, to use RDF ontologies and thesauri: - (optional) mechanize, to run regression web test suite: - (optional) python-mock, mocking library for the test suite: - (optional) utidylib, for HTML washing: - (optional) Beautiful Soup, for HTML washing: - (optional) Python Twitter (and its dependencies) if you want to use the Twitter Fetcher bibtasklet: - (optional) Python OpenID if you want to enable OpenID support for authentication: - (optional) Python Rauth if you want to enable OAuth 1.0/2.0 support for authentication (depends on Python-2.6 or later): - (optional) libhdf5-7, libhdf5-dev, python-h5py, in order to run author disambiguation. Note that if you are using pip to install and manage your Python dependencies, then you can run: $ sudo pip install -r requirements.txt $ sudo pip install -r requirements-extras.txt to install all manadatory, recommended, and optional packages mentioned above. f) mod_wsgi Apache module. Versions 3.x and above are recommended. g) If you want to be able to extract references from PDF fulltext files, then you need to install pdftotext version 3 at least. h) If you want to be able to search for words in the fulltext files (i.e. to have fulltext indexing) or to stamp submitted files, then you need as well to install some of the following tools: - for Microsoft Office/OpenOffice.org document conversion: OpenOffice.org - for PDF file stamping: pdftk, pdf2ps - for PDF files: pdftotext or pstotext - for PostScript files: pstotext or ps2ascii - for DjVu creation, elaboration: DjVuLibre - to perform OCR: OCRopus (tested only with release 0.3.1) - to perform different image elaborations: ImageMagick - to generate PDF after OCR: netpbm, ReportLab and pyPdf or pyPdf2 i) If you have chosen to install fast XML MARC Python processors in the step d) above, then you have to install the parsers themselves: - (optional) 4suite: j) (recommended) Gnuplot, the command-line driven interactive plotting program. It is used to display download and citation history graphs on the Detailed record pages on the web interface. Note that Gnuplot must be compiled with PNG output support, that is, with the GD library. Note also that Gnuplot is not required, only recommended. k) (recommended) A Common Lisp implementation, such as CLISP, SBCL or CMUCL. It is used for the web server log analysing tool and the metadata checking program. Note that any of the three implementations CLISP, SBCL, or CMUCL will do. CMUCL produces fastest machine code, but it does not support UTF-8 yet. Pick up CLISP if you don't know what to do. Note that a Common Lisp implementation is not required, only recommended. l) GNU gettext, a set of tools that makes it possible to translate the application in multiple languages. This is available by default on many systems. m) (recommended) xlwt 0.7.2, Library to create spreadsheet files compatible with MS Excel 97/2000/XP/2003 XLS files, on any platform, with Python 2.3 to 2.6 n) (recommended) matplotlib 1.0.0 is a python 2D plotting library which produces publication quality figures in a variety of hardcopy formats and interactive environments across platforms. matplotlib can be used in python scripts, the python and ipython shell (ala MATLAB® or Mathematica®), web application servers, and six graphical user interface toolkits. It is used to generate pie graphs in the custom summary query (WebStat) o) (optional) FFmpeg, an open-source tools an libraries collection to convert video and audio files. It makes use of both internal as well as external libraries to generate videos for the web, such as Theora, WebM and H.264 out of almost any thinkable video input. FFmpeg is needed to run video related modules and submission workflows in Invenio. The minimal configuration of ffmpeg for the Invenio demo site requires a number of external libraries. It is highly recommended to remove all installed versions and packages that are comming with various Linux distributions and install the latest versions from sources. Additionally, you will need the Mediainfo Library for multimedia metadata handling. Minimum libraries for the demo site: - the ffmpeg multimedia encoder tools - a library for jpeg images needed for thumbnail extraction - a library for the ogg container format, needed for Vorbis and Theora - the OGG Vorbis audi codec library - the OGG Theora video codec library - the WebM video codec library - the mediainfo library for multimedia metadata Recommended for H.264 video (!be aware of licensing issues!): - a library for H.264 video encoding - a library for Advanced Audi Coding - a library for MP3 encoding Note that the configure script checks whether you have all the prerequisite software installed and that it won't let you continue unless everything is in order. It also warns you if it cannot find some optional but recommended software. 1. Quick instructions for the impatient Invenio admin ========================================================= 1a. Installation ---------------- $ cd $HOME/src/ - $ wget http://invenio-software.org/download/invenio-1.1.5.tar.gz - $ wget http://invenio-software.org/download/invenio-1.1.5.tar.gz.md5 - $ wget http://invenio-software.org/download/invenio-1.1.5.tar.gz.sig - $ md5sum -c invenio-1.1.5.tar.gz.md5 - $ gpg --verify invenio-1.1.5.tar.gz.sig invenio-1.1.5.tar.gz - $ tar xvfz invenio-1.1.5.tar.gz - $ cd invenio-1.1.5 + $ wget http://invenio-software.org/download/invenio-1.2.0.tar.gz + $ wget http://invenio-software.org/download/invenio-1.2.0.tar.gz.md5 + $ wget http://invenio-software.org/download/invenio-1.2.0.tar.gz.sig + $ md5sum -c invenio-1.2.0.tar.gz.md5 + $ gpg --verify invenio-1.2.0.tar.gz.sig invenio-1.2.0.tar.gz + $ tar xvfz invenio-1.2.0.tar.gz + $ cd invenio-1.2.0 $ ./configure $ make $ make install $ make install-mathjax-plugin ## optional $ make install-jquery-plugins ## optional $ make install-ckeditor-plugin ## optional $ make install-pdfa-helper-files ## optional $ make install-mediaelement ## optional $ make install-solrutils ## optional $ make install-js-test-driver ## optional 1b. Configuration ----------------- $ sudo chown -R www-data.www-data /opt/invenio $ sudo -u www-data emacs /opt/invenio/etc/invenio-local.conf $ sudo -u www-data /opt/invenio/bin/inveniocfg --update-all $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-tables $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-bibfield-conf $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-webstat-conf $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-apache-conf $ sudo /etc/init.d/apache2 restart $ sudo -u www-data /opt/invenio/bin/inveniocfg --check-openoffice $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-demo-site $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-demo-records $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-unit-tests $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-regression-tests $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-web-tests $ sudo -u www-data /opt/invenio/bin/inveniocfg --remove-demo-records $ sudo -u www-data /opt/invenio/bin/inveniocfg --drop-demo-site $ firefox http://your.site.com/help/admin/howto-run 2. Detailed instructions for the patient Invenio admin ========================================================== 2a. Installation ---------------- The Invenio uses standard GNU autoconf method to build and install its files. This means that you proceed as follows: $ cd $HOME/src/ Change to a directory where we will build the Invenio sources. (The built files will be installed into different "target" directories later.) - $ wget http://invenio-software.org/download/invenio-1.1.5.tar.gz - $ wget http://invenio-software.org/download/invenio-1.1.5.tar.gz.md5 - $ wget http://invenio-software.org/download/invenio-1.1.5.tar.gz.sig + $ wget http://invenio-software.org/download/invenio-1.2.0.tar.gz + $ wget http://invenio-software.org/download/invenio-1.2.0.tar.gz.md5 + $ wget http://invenio-software.org/download/invenio-1.2.0.tar.gz.sig Fetch Invenio source tarball from the distribution server, together with MD5 checksum and GnuPG cryptographic signature files useful for verifying the integrity of the tarball. - $ md5sum -c invenio-1.1.5.tar.gz.md5 + $ md5sum -c invenio-1.2.0.tar.gz.md5 Verify MD5 checksum. - $ gpg --verify invenio-1.1.5.tar.gz.sig invenio-1.1.5.tar.gz + $ gpg --verify invenio-1.2.0.tar.gz.sig invenio-1.2.0.tar.gz Verify GnuPG cryptographic signature. Note that you may first have to import my public key into your keyring, if you haven't done that already: $ gpg --keyserver pool.sks-keyservers.net --recv-key 0xBA5A2B67 The output of the gpg --verify command should then read: Good signature from "Tibor Simko " You can safely ignore any trusted signature certification warning that may follow after the signature has been successfully verified. - $ tar xvfz invenio-1.1.5.tar.gz + $ tar xvfz invenio-1.2.0.tar.gz Untar the distribution tarball. - $ cd invenio-1.1.5 + $ cd invenio-1.2.0 Go to the source directory. $ ./configure Configure Invenio software for building on this specific platform. You can use the following optional parameters: --prefix=/opt/invenio Optionally, specify the Invenio general installation directory (default is /opt/invenio). It will contain command-line binaries and program libraries containing the core Invenio functionality, but also store web pages, runtime log and cache information, document data files, etc. Several subdirs like `bin', `etc', `lib', or `var' will be created inside the prefix directory to this effect. Note that the prefix directory should be chosen outside of the Apache htdocs tree, since only one its subdirectory (prefix/var/www) is to be accessible directly via the Web (see below). Note that Invenio won't install to any other directory but to the prefix mentioned in this configuration line. --with-python=/opt/python/bin/python2.7 Optionally, specify a path to some specific Python binary. This is useful if you have more than one Python installation on your system. If you don't set this option, then the first Python that will be found in your PATH will be chosen for running Invenio. --with-mysql=/opt/mysql/bin/mysql Optionally, specify a path to some specific MySQL client binary. This is useful if you have more than one MySQL installation on your system. If you don't set this option, then the first MySQL client executable that will be found in your PATH will be chosen for running Invenio. --with-clisp=/opt/clisp/bin/clisp Optionally, specify a path to CLISP executable. This is useful if you have more than one CLISP installation on your system. If you don't set this option, then the first executable that will be found in your PATH will be chosen for running Invenio. --with-cmucl=/opt/cmucl/bin/lisp Optionally, specify a path to CMUCL executable. This is useful if you have more than one CMUCL installation on your system. If you don't set this option, then the first executable that will be found in your PATH will be chosen for running Invenio. --with-sbcl=/opt/sbcl/bin/sbcl Optionally, specify a path to SBCL executable. This is useful if you have more than one SBCL installation on your system. If you don't set this option, then the first executable that will be found in your PATH will be chosen for running Invenio. --with-openoffice-python Optionally, specify the path to the Python interpreter embedded with OpenOffice.org. This is normally not contained in the normal path. If you don't specify this it won't be possible to use OpenOffice.org to convert from and to Microsoft Office and OpenOffice.org documents. This configuration step is mandatory. Usually, you do this step only once. (Note that if you are building Invenio not from a released tarball, but from the Git sources, then you have to generate the configure file via autotools: $ sudo aptitude install automake1.9 autoconf $ aclocal-1.9 $ automake-1.9 -a $ autoconf after which you proceed with the usual configure command.) $ make Launch the Invenio build. Since many messages are printed during the build process, you may want to run it in a fast-scrolling terminal such as rxvt or in a detached screen session. During this step all the pages and scripts will be pre-created and customized based on the config you have edited in the previous step. Note that on systems such as FreeBSD or Mac OS X you have to use GNU make ("gmake") instead of "make". $ make install Install the web pages, scripts, utilities and everything needed for Invenio runtime into respective installation directories, as specified earlier by the configure command. Note that if you are installing Invenio for the first time, you will be asked to create symbolic link(s) from Python's site-packages system-wide directory(ies) to the installation location. This is in order to instruct Python where to find Invenio's Python files. You will be hinted as to the exact command to use based on the parameters you have used in the configure command. $ make install-mathjax-plugin ## optional This will automatically download and install in the proper place MathJax, a JavaScript library to render LaTeX formulas in the client browser. Note that in order to enable the rendering you will have to set the variable CFG_WEBSEARCH_USE_MATHJAX_FOR_FORMATS in invenio-local.conf to a suitable list of output format codes. For example: CFG_WEBSEARCH_USE_MATHJAX_FOR_FORMATS = hd,hb $ make install-jquery-plugins ## optional This will automatically download and install in the proper place jQuery and related plugins. They are used for AJAX applications such as the record editor. Note that `unzip' is needed when installing jquery plugins. $ make install-ckeditor-plugin ## optional This will automatically download and install in the proper place CKeditor, a WYSIWYG Javascript-based editor (e.g. for the WebComment module). Note that in order to enable the editor you have to set the CFG_WEBCOMMENT_USE_RICH_EDITOR to True. $ make install-pdfa-helper-files ## optional This will automatically download and install in the proper place the helper files needed to create PDF/A files out of existing PDF files. $ make install-mediaelement ## optional This will automatically download and install the MediaElementJS HTML5 video player that is needed for videos on the DEMO site. $ make install-solrutils ## optional This will automatically download and install a Solr instance which can be used for full-text searching. See CFG_SOLR_URL variable in the invenio.conf. Note that the admin later has to take care of running init.d scripts which would start the Solr instance automatically. $ make install-js-test-driver ## optional This will automatically download and install JsTestDriver which is needed to run JS unit tests. Recommended for developers. 2b. Configuration ----------------- Once the basic software installation is done, we proceed to configuring your Invenio system. $ sudo chown -R www-data.www-data /opt/invenio For the sake of simplicity, let us assume that your Invenio installation will run under the `www-data' user process identity. The above command changes ownership of installed files to www-data, so that we shall run everything under this user identity from now on. For production purposes, you would typically enable Apache server to read all files from the installation place but to write only to the `var' subdirectory of your installation place. You could achieve this by configuring Unix directory group permissions, for example. $ sudo -u www-data emacs /opt/invenio/etc/invenio-local.conf Customize your Invenio installation. Please read the 'invenio.conf' file located in the same directory that contains the vanilla default configuration parameters of your Invenio installation. If you want to customize some of these parameters, you should create a file named 'invenio-local.conf' in the same directory where 'invenio.conf' lives and you should write there only the customizations that you want to be different from the vanilla defaults. Here is a realistic, minimalist, yet production-ready example of what you would typically put there: $ cat /opt/invenio/etc/invenio-local.conf [Invenio] CFG_SITE_NAME = John Doe's Document Server CFG_SITE_NAME_INTL_fr = Serveur des Documents de John Doe CFG_SITE_URL = http://your.site.com CFG_SITE_SECURE_URL = https://your.site.com CFG_SITE_ADMIN_EMAIL = john.doe@your.site.com CFG_SITE_SUPPORT_EMAIL = john.doe@your.site.com CFG_WEBALERT_ALERT_ENGINE_EMAIL = john.doe@your.site.com CFG_WEBCOMMENT_ALERT_ENGINE_EMAIL = john.doe@your.site.com CFG_WEBCOMMENT_DEFAULT_MODERATOR = john.doe@your.site.com CFG_BIBAUTHORID_AUTHOR_TICKET_ADMIN_EMAIL = john.doe@your.site.com CFG_BIBCATALOG_SYSTEM_EMAIL_ADDRESS = john.doe@your.site.com CFG_DATABASE_HOST = localhost CFG_DATABASE_NAME = invenio CFG_DATABASE_USER = invenio CFG_DATABASE_PASS = my123p$ss CFG_BIBDOCFILE_ENABLE_BIBDOCFSINFO_CACHE = 1 You should override at least the parameters mentioned above in order to define some very essential runtime parameters such as the name of your document server (CFG_SITE_NAME and CFG_SITE_NAME_INTL_*), the visible URL of your document server (CFG_SITE_URL and CFG_SITE_SECURE_URL), the email address of the local Invenio administrator, comment moderator, and alert engine (CFG_SITE_SUPPORT_EMAIL, CFG_SITE_ADMIN_EMAIL, etc), and last but not least your database credentials (CFG_DATABASE_*). If this is a first installation of Invenio it is recommended you set the CFG_BIBDOCFILE_ENABLE_BIBDOCFSINFO_CACHE variable to 1. If this is instead an upgrade from an existing installation don't add it until you have run: $ bibdocfile --fix-bibdocfsinfo-cache . The Invenio system will then read both the default invenio.conf file and your customized invenio-local.conf file and it will override any default options with the ones you have specifield in your local file. This cascading of configuration parameters will ease your future upgrades. If you want to have multiple Invenio instances for distributed video encoding, you need to share the same configuration amongs them and make some of the folders of the Invenio installation available for all nodes. Configure the allowed tasks for every node: CFG_BIBSCHED_NODE_TASKS = { "hostname_machine1" : ["bibindex", "bibupload", "bibreformat","webcoll", "bibtaskex", "bibrank", "oaiharvest", "oairepositoryupdater", "inveniogc", "webstatadmin", "bibclassify", "bibexport", "dbdump", "batchuploader", "bibauthorid", "bibtasklet"], "hostname_machine2" : ['bibencode',] } Share the following directories among Invenio instances: /var/tmp-shared hosts video uploads in a temporary form /var/tmp-shared/bibencode/jobs hosts new job files for the video encoding daemon /var/tmp-shared/bibencode/jobs/done hosts job files that have been processed by the daemon /var/data/files hosts fulltext and media files associated to records /var/data/submit hosts files created during submissions $ sudo -u www-data /opt/invenio/bin/inveniocfg --update-all Make the rest of the Invenio system aware of your invenio-local.conf changes. This step is mandatory each time you edit your conf files. $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-tables If you are installing Invenio for the first time, you have to create database tables. Note that this step checks for potential problems such as the database connection rights and may ask you to perform some more administrative steps in case it detects a problem. Notably, it may ask you to set up database access permissions, based on your configure values. If you are installing Invenio for the first time, you have to create a dedicated database on your MySQL server that the Invenio can use for its purposes. Please contact your MySQL administrator and ask him to execute the commands this step proposes you. At this point you should now have successfully completed the "make install" process. We continue by setting up the Apache web server. $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-bibfield-conf Load the configuration file of the BibField module. It will create `bibfield_config.py' file. (FIXME: When BibField becomes essential part of Invenio, this step should be later automatised so that people do not have to run it manually.) $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-webstat-conf Load the configuration file of webstat module. It will create the tables in the database for register customevents, such as basket hits. $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-apache-conf Running this command will generate Apache virtual host configurations matching your installation. You will be instructed to check created files (usually they are located under /opt/invenio/etc/apache/) and edit your httpd.conf to activate Invenio virtual hosts. If you are using Debian GNU/Linux ``Lenny'' or later, then you can do the following to create your SSL certificate and to activate your Invenio vhosts: ## make SSL certificate: $ sudo aptitude install ssl-cert $ sudo mkdir /etc/apache2/ssl $ sudo /usr/sbin/make-ssl-cert /usr/share/ssl-cert/ssleay.cnf \ /etc/apache2/ssl/apache.pem ## add Invenio web sites: $ sudo ln -s /opt/invenio/etc/apache/invenio-apache-vhost.conf \ /etc/apache2/sites-available/invenio $ sudo ln -s /opt/invenio/etc/apache/invenio-apache-vhost-ssl.conf \ /etc/apache2/sites-available/invenio-ssl ## disable Debian's default web site: $ sudo /usr/sbin/a2dissite default ## enable Invenio web sites: $ sudo /usr/sbin/a2ensite invenio $ sudo /usr/sbin/a2ensite invenio-ssl ## enable SSL module: $ sudo /usr/sbin/a2enmod ssl ## if you are using xsendfile module, enable it too: $ sudo /usr/sbin/a2enmod xsendfile If you are using another operating system, you should do the equivalent, for example edit your system-wide httpd.conf and put the following include statements: Include /opt/invenio/etc/apache/invenio-apache-vhost.conf Include /opt/invenio/etc/apache/invenio-apache-vhost-ssl.conf Note that you may need to adapt generated vhost file snippets to match your concrete operating system specifics. For example, the generated configuration snippet will preload Invenio WSGI daemon application upon Apache start up for faster site response. The generated configuration assumes that you are using mod_wsgi version 3 or later. If you are using the old legacy mod_wsgi version 2, then you would need to comment out the WSGIImportScript directive from the generated snippet, or else move the WSGI daemon setup to the top level, outside of the VirtualHost section. Note also that you may want to tweak the generated Apache vhost snippet for performance reasons, especially with respect to WSGIDaemonProcess parameters. For example, you can increase the number of processes from the default value `processes=5' if you have lots of RAM and if many concurrent users may access your site in parallel. However, note that you must use `threads=1' there, because Invenio WSGI daemon processes are not fully thread safe yet. This may change in the future. $ sudo /etc/init.d/apache2 restart Please ask your webserver administrator to restart the Apache server after the above "httpd.conf" changes. $ sudo -u www-data /opt/invenio/bin/inveniocfg --check-openoffice If you plan to support MS Office or Open Document Format files in your installation, you should check whether LibreOffice or OpenOffice.org is well integrated with Invenio by running the above command. You may be asked to create a temporary directory for converting office files with special ownership (typically as user nobody) and permissions. Note that you can do this step later. $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-demo-site This step is recommended to test your local Invenio installation. It should give you our "Atlantis Institute of Science" demo installation, exactly as you see it at . $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-demo-records Optionally, load some demo records to be able to test indexing and searching of your local Invenio demo installation. $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-unit-tests Optionally, you can run the unit test suite to verify the unit behaviour of your local Invenio installation. Note that this command should be run only after you have installed the whole system via `make install'. $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-regression-tests Optionally, you can run the full regression test suite to verify the functional behaviour of your local Invenio installation. Note that this command requires to have created the demo site and loaded the demo records. Note also that running the regression test suite may alter the database content with junk data, so that rebuilding the demo site is strongly recommended afterwards. $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-web-tests Optionally, you can run additional automated web tests running in a real browser. This requires to have Firefox with the Selenium IDE extension installed. $ sudo -u www-data /opt/invenio/bin/inveniocfg --remove-demo-records Optionally, remove the demo records loaded in the previous step, but keeping otherwise the demo collection, submission, format, and other configurations that you may reuse and modify for your own production purposes. $ sudo -u www-data /opt/invenio/bin/inveniocfg --drop-demo-site Optionally, drop also all the demo configuration so that you'll end up with a completely blank Invenio system. However, you may want to find it more practical not to drop the demo site configuration but to start customizing from there. $ firefox http://your.site.com/help/admin/howto-run In order to start using your Invenio installation, you can start indexing, formatting and other daemons as indicated in the "HOWTO Run" guide on the above URL. You can also use the Admin Area web interfaces to perform further runtime configurations such as the definition of data collections, document types, document formats, word indexes, etc. $ sudo ln -s /opt/invenio/etc/bash_completion.d/inveniocfg \ /etc/bash_completion.d/inveniocfg Optionally, if you are using Bash shell completion, then you may want to create the above symlink in order to configure completion for the inveniocfg command. Good luck and thanks for choosing Invenio. - Invenio Development Team Email: info@invenio-software.org IRC: #invenio on irc.freenode.net Twitter: http://twitter.com/inveniosoftware Github: http://github.com/inveniosoftware URL: http://invenio-software.org diff --git a/Makefile.am b/Makefile.am index 71cc17c63..6f44617c9 100644 --- a/Makefile.am +++ b/Makefile.am @@ -1,488 +1,488 @@ # This file is part of Invenio. # Copyright (C) 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2009, 2010, 2011, 2012, 2013, 2014, 2015 CERN. # # Invenio is free software; you can redistribute it and/or # modify it under the terms of the GNU General Public License as # published by the Free Software Foundation; either version 2 of the # License, or (at your option) any later version. # # Invenio is distributed in the hope that it will be useful, but # WITHOUT ANY WARRANTY; without even the implied warranty of # MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU # General Public License for more details. # # You should have received a copy of the GNU General Public License # along with Invenio; if not, write to the Free Software Foundation, Inc., # 59 Temple Place, Suite 330, Boston, MA 02111-1307, USA. confignicedir = $(sysconfdir)/build confignice_SCRIPTS=config.nice SUBDIRS = po config modules EXTRA_DIST = UNINSTALL THANKS RELEASE-NOTES configure-tests.py config.nice.in \ - config.rpath + config.rpath CONTRIBUTING.rst Dockerfile docker-compose.yml # current MathJax version and packages # See also modules/miscutil/lib/htmlutils.py (get_mathjax_header) MJV = 2.3 MATHJAX = http://invenio-software.org/download/mathjax/MathJax-v$(MJV).zip # current CKeditor version CKV = 3.6.6 CKEDITOR = ckeditor_$(CKV).zip # current MediaElement.js version MEV = master MEDIAELEMENT = http://github.com/johndyer/mediaelement/zipball/$(MEV) #for solrutils INVENIO_JAVA_PATH = org/invenio_software/solr solrdirname = apache-solr-3.1.0 solrdir = $(prefix)/lib/$(solrdirname) solrutils_dir=$(CURDIR)/modules/miscutil/lib/solrutils CLASSPATH=.:${solrdir}/dist/solrj-lib/commons-io-1.4.jar:${solrdir}/dist/apache-solr-core-*jar:${solrdir}/contrib/jzlib-1.0.7.jar:${solrdir}/dist/apache-solr-solrj-3.1.0.jar:${solrdir}/dist/solrj-lib/slf4j-api-1.5.5.jar:${solrdir}/dist/*:${solrdir}/contrib/basic-lucene-libs/*:${solrdir}/contrib/analysis-extras/lucene-libs/*:${solrdir}/dist/solrj-lib/* # git-version-get stuff: BUILT_SOURCES = $(top_srcdir)/.version $(top_srcdir)/.version: echo $(VERSION) > $@-t && mv $@-t $@ dist-hook: echo $(VERSION) > $(distdir)/.tarball-version check-upgrade: $(PYTHON) $(top_srcdir)/modules/miscutil/lib/inveniocfg_upgrader.py $(top_srcdir) --upgrade-check kwalitee-check: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --stats $(top_srcdir) kwalitee-check-errors-only: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --check-errors $(top_srcdir) kwalitee-check-variables: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --check-variables $(top_srcdir) kwalitee-check-indentation: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --check-indentation $(top_srcdir) kwalitee-check-sql-queries: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --check-sql $(top_srcdir) etags: \rm -f $(top_srcdir)/TAGS (cd $(top_srcdir) && find $(top_srcdir) -name "*.py" -print | xargs etags) install-data-local: for d in / /cache /cache/RTdata /log /tmp /tmp-shared /data /run /tmp-shared/bibencode/jobs/done /tmp-shared/bibedit-cache; do \ mkdir -p $(localstatedir)$$d ; \ done @echo "************************************************************" @echo "** Invenio software has been successfully installed! **" @echo "** **" @echo "** You may proceed to customizing your installation now. **" @echo "************************************************************" install-mathjax-plugin: @echo "***********************************************************" @echo "** Installing MathJax plugin, please wait... **" @echo "***********************************************************" rm -rf /tmp/invenio-mathjax-plugin mkdir /tmp/invenio-mathjax-plugin rm -fr ${prefix}/var/www/MathJax mkdir -p ${prefix}/var/www/MathJax (cd /tmp/invenio-mathjax-plugin && \ wget '$(MATHJAX)' -O mathjax.zip && \ unzip -q mathjax.zip && cd mathjax-MathJax-* && cp -r * \ ${prefix}/var/www/MathJax) rm -fr /tmp/invenio-mathjax-plugin @echo "************************************************************" @echo "** The MathJax plugin was successfully installed. **" @echo "** Please do not forget to properly set the option **" @echo "** CFG_WEBSEARCH_USE_MATHJAX_FOR_FORMATS and **" @echo "** CFG_WEBSUBMIT_USE_MATHJAX in invenio.conf. **" @echo "************************************************************" uninstall-mathjax-plugin: @rm -rvf ${prefix}/var/www/MathJax @echo "***********************************************************" @echo "** The MathJax plugin was successfully uninstalled. **" @echo "***********************************************************" install-jscalendar-plugin: @echo "***********************************************************" @echo "** Installing jsCalendar plugin, please wait... **" @echo "***********************************************************" rm -rf /tmp/invenio-jscalendar-plugin mkdir /tmp/invenio-jscalendar-plugin (cd /tmp/invenio-jscalendar-plugin && \ wget 'http://www.dynarch.com/static/jscalendar-1.0.zip' && \ unzip -u jscalendar-1.0.zip && \ mkdir -p ${prefix}/var/www/jsCalendar && \ cp jscalendar-1.0/img.gif ${prefix}/var/www/jsCalendar/jsCalendar.gif && \ cp jscalendar-1.0/calendar.js ${prefix}/var/www/jsCalendar/ && \ cp jscalendar-1.0/calendar-setup.js ${prefix}/var/www/jsCalendar/ && \ cp jscalendar-1.0/lang/calendar-en.js ${prefix}/var/www/jsCalendar/ && \ cp jscalendar-1.0/calendar-blue.css ${prefix}/var/www/jsCalendar/) rm -fr /tmp/invenio-jscalendar-plugin @echo "***********************************************************" @echo "** The jsCalendar plugin was successfully installed. **" @echo "***********************************************************" uninstall-jscalendar-plugin: @rm -rvf ${prefix}/var/www/jsCalendar @echo "***********************************************************" @echo "** The jsCalendar plugin was successfully uninstalled. **" @echo "***********************************************************" install-js-test-driver: @echo "*******************************************************" @echo "** Installing js-test-driver, please wait... **" @echo "*******************************************************" mkdir -p $(prefix)/lib/java/js-test-driver && \ cd $(prefix)/lib/java/js-test-driver && \ wget http://invenio-software.org/download/js-test-driver/JsTestDriver-1.3.5.jar -O JsTestDriver.jar uninstall-js-test-driver: @rm -rvf ${prefix}/lib/java/js-test-driver @echo "*********************************************************" @echo "** The js-test-driver was successfully uninstalled. **" @echo "*********************************************************" install-jquery-plugins: @echo "***********************************************************" @echo "** Installing various jQuery plugins, please wait... **" @echo "***********************************************************" mkdir -p ${prefix}/var/www/js mkdir -p $(prefix)/var/www/css (cd ${prefix}/var/www/js && \ wget -O jquery.min.js http://invenio-software.org/download/jquery/jquery-1.7.1.min.js && \ wget -N http://ajax.googleapis.com/ajax/libs/jqueryui/1.8.17/jquery-ui.min.js && \ wget -O jquery.jeditable.mini.js http://invenio-software.org/download/jquery/jquery.jeditable.custom.min.js && \ wget -N https://raw.githubusercontent.com/malsup/form/3.51/jquery.form.js --no-check-certificate && \ wget -N http://jquery-multifile-plugin.googlecode.com/svn-history/r54/trunk/jquery.MultiFile.pack.js && \ wget -O jquery.tablesorter.zip http://invenio-software.org/download/jquery/jquery.tablesorter.20111208.zip && \ wget -O uploadify.zip http://invenio-software.org/download/jquery/uploadify-v2.1.4.zip && \ wget -N http://cdn.datatables.net/1.10.4/js/jquery.dataTables.min.js && \ wget -N http://invenio-software.org/download/jquery/jquery.bookmark.package-1.4.0.zip && \ unzip -u jquery.tablesorter.zip -d tablesorter && \ wget -N http://invenio-software.org/download/jquery/jquery.fileTree-1.01.zip && \ unzip -u jquery.fileTree-1.01.zip && \ rm jquery.fileTree-1.01.zip && \ wget -N http://invenio-software.org/download/jquery/ColVis.min.js && \ mv ColVis.min.js jquery.dataTables.ColVis.min.js && \ rm jquery.tablesorter.zip && \ rm -rf uploadify && \ unzip -u uploadify.zip -d uploadify && \ wget -N http://invenio-software.org/download/jquery/flot-0.6.zip && \ wget -N http://www.csspace.net/tmp/jquery-lightbox-0.5.zip && \ rm -rf jquery-lightbox && \ unzip -u jquery-lightbox-0.5.zip -d jquery-lightbox && \ sed -i 's/images\//\/js\/jquery-lightbox\/images\//g' jquery-lightbox/js/jquery.lightbox-0.5.js && \ rm -rf jquery-lightbox-0.5.zip && \ wget -O jquery-ui-timepicker-addon.js http://invenio-software.org/download/jquery/jquery-ui-timepicker-addon-1.0.3.js && \ unzip -u flot-0.6.zip && \ mv flot/jquery.flot.selection.min.js flot/jquery.flot.min.js flot/excanvas.min.js ./ && \ rm flot-0.6.zip && rm -r flot && \ mv uploadify/swfobject.js ./ && \ mv uploadify/cancel.png uploadify/uploadify.css uploadify/uploadify.allglyphs.swf uploadify/uploadify.fla uploadify/uploadify.swf ../img/ && \ mv uploadify/jquery.uploadify.v2.1.4.min.js ./jquery.uploadify.min.js && \ rm uploadify.zip && rm -r uploadify && \ wget -N https://github.com/douglascrockford/JSON-js/raw/master/json2.js --no-check-certificate && \ wget -O jquery.hotkeys.js http://invenio-software.org/download/jquery/jquery.hotkeys-0.8.js && \ wget -N http://invenio-software.org/download/jquery/jquery.treeview.zip && \ unzip -u jquery.treeview.zip -d jquery-treeview && \ rm jquery.treeview.zip && \ wget -N http://invenio-software.org/download/jquery/v1.5/js/jquery.ajaxPager.js && \ unzip -u jquery.bookmark.package-1.4.0.zip && \ rm -f jquery.bookmark.ext.* bookmarks-big.png bookmarkBasic.html jquery.bookmark.js jquery.bookmark.pack.js && \ mv bookmarks.png ../img/ && \ mv jquery.bookmark.css ../css/ && \ wget -N --no-check-certificate http://invenio-software.org/download/jquery/jquery.omniwindow.js && \ wget -N --no-check-certificate http://invenio-software.org/download/jquery/jquery.blockUI.js && \ wget -N --no-check-certificate http://invenio-software.org/download/jquery/sly.min.js &&\ wget -N --no-check-certificate http://invenio-software.org/download/jquery/parsley.js &&\ wget -N --no-check-certificate http://invenio-software.org/download/jquery/spin.min.js &&\ rm -f jquery.bookmark.package-1.4.0.zip && \ mkdir -p ${prefix}/var/www/img && \ cd ${prefix}/var/www/img && \ wget -r -np -nH --cut-dirs=4 -A "png,css" -P jquery-ui/themes http://jquery-ui.googlecode.com/svn/tags/1.8.17/themes/base/ && \ wget -r -np -nH --cut-dirs=4 -A "png,css" -P jquery-ui/themes http://jquery-ui.googlecode.com/svn/tags/1.8.17/themes/smoothness/ && \ wget -r -np -nH --cut-dirs=4 -A "png,css" -P jquery-ui/themes http://jquery-ui.googlecode.com/svn/tags/1.8.17/themes/redmond/ && \ wget --no-check-certificate -O datatables_jquery-ui.css https://raw.githubusercontent.com/DataTables/DataTables/1.10.0/media/css/demo_table_jui.css && \ wget -N http://jquery-ui.googlecode.com/svn/tags/1.8.17/themes/redmond/jquery-ui.css && \ wget -N http://jquery-ui.googlecode.com/svn/tags/1.8.17/demos/images/calendar.gif && \ wget -r -np -nH --cut-dirs=5 -A "png" http://jquery-ui.googlecode.com/svn/tags/1.8.17/themes/redmond/images/) @echo "***********************************************************" @echo "** The jQuery plugins were successfully installed. **" @echo "***********************************************************" uninstall-jquery-plugins: (cd ${prefix}/var/www/js && \ rm -f jquery.min.js && \ rm -f jquery.MultiFile.pack.js && \ rm -f jquery.jeditable.mini.js && \ rm -f jquery.flot.selection.min.js && \ rm -f jquery.flot.min.js && \ rm -f excanvas.min.js && \ rm -f jquery-ui-timepicker-addon.min.js && \ rm -f json2.js && \ rm -f jquery.uploadify.min.js && \ rm -rf tablesorter && \ rm -rf jquery-treeview && \ rm -f jquery.ajaxPager.js && \ rm -f jquery.form.js && \ rm -f jquery.dataTables.min.js && \ rm -f ui.core.js && \ rm -f jquery.bookmark.min.js && \ rm -f jquery.dataTables.ColVis.min.js && \ rm -f jquery.hotkeys.js && \ rm -f jquery.tablesorter.min.js && \ rm -f jquery-ui-1.7.3.custom.min.js && \ rm -f jquery.metadata.js && \ rm -f jquery-latest.js && \ rm -f jquery-ui.min.js && \ rm -rf jquery-lightbox && \ rm -f jquery-ui-timepicker-addon.js && \ rm -rf jqueryFileTree && \ rm -f swfobject.js && \ rm -f jquery.blockUI.js && \ rm -f sly.min.js && \ rm -f parsley.js && \ rm -f spin.min.js && \ rm -f jquery.omniwindow.js) (cd ${prefix}/var/www/img && \ rm -f cancel.png uploadify.css uploadify.swf uploadify.allglyphs.swf uploadify.fla && \ rm -f datatables_jquery-ui.css \ rm -f bookmarks.png \ rm -f demo_table_jui.css \ rm -f calendar.gif \ rm -rf jquery-ui/themes) && \ (cd ${prefix}/var/www/css && \ rm -f jquery.bookmark.css) @echo "***********************************************************" @echo "** The jquery plugins were successfully uninstalled. **" @echo "***********************************************************" install-ckeditor-plugin: @echo "***********************************************************" @echo "** Installing CKeditor plugin, please wait... **" @echo "***********************************************************" rm -rf ${prefix}/lib/python/invenio/ckeditor/ rm -rf /tmp/invenio-ckeditor-plugin mkdir /tmp/invenio-ckeditor-plugin (cd /tmp/invenio-ckeditor-plugin && \ wget 'http://invenio-software.org/download/ckeditor/$(CKEDITOR)' && \ unzip -u -d ${prefix}/var/www $(CKEDITOR)) && \ find ${prefix}/var/www/ckeditor/ -depth -name '_*' -exec rm -rf {} \; && \ find ${prefix}/var/www/ckeditor/ckeditor* -maxdepth 0 ! -name "ckeditor.js" -exec rm -r {} \; && \ rm -fr /tmp/invenio-ckeditor-plugin @echo "* Installing Invenio-specific CKeditor config..." (cd $(top_srcdir)/modules/webstyle/etc && make install) @echo "***********************************************************" @echo "** The CKeditor plugin was successfully installed. **" @echo "** Please do not forget to properly set the option **" @echo "** CFG_WEBCOMMENT_USE_RICH_TEXT_EDITOR in invenio.conf. **" @echo "***********************************************************" uninstall-ckeditor-plugin: @rm -rvf ${prefix}/var/www/ckeditor @rm -rvf ${prefix}/lib/python/invenio/ckeditor @echo "***********************************************************" @echo "** The CKeditor plugin was successfully uninstalled. **" @echo "***********************************************************" install-pdfa-helper-files: @echo "***********************************************************" @echo "** Installing PDF/A helper files, please wait... **" @echo "***********************************************************" wget 'http://invenio-software.org/download/invenio-demo-site-files/ISOCoatedsb.icc' -O ${prefix}/etc/websubmit/file_converter_templates/ISOCoatedsb.icc @echo "***********************************************************" @echo "** The PDF/A helper files were successfully installed. **" @echo "***********************************************************" install-mediaelement: @echo "***********************************************************" @echo "** MediaElement.js, please wait... **" @echo "***********************************************************" rm -rf /tmp/mediaelement mkdir /tmp/mediaelement wget 'http://github.com/johndyer/mediaelement/zipball/master' -O '/tmp/mediaelement/mediaelement.zip' --no-check-certificate unzip -u -d '/tmp/mediaelement' '/tmp/mediaelement/mediaelement.zip' rm -rf ${prefix}/var/www/mediaelement mkdir ${prefix}/var/www/mediaelement mv /tmp/mediaelement/johndyer-mediaelement-*/build/* ${prefix}/var/www/mediaelement rm -rf /tmp/mediaelement @echo "***********************************************************" @echo "** MediaElement.js was successfully installed. **" @echo "***********************************************************" uninstall-pdfa-helper-files: rm -f ${prefix}/etc/websubmit/file_converter_templates/ISOCoatedsb.icc @echo "***********************************************************" @echo "** The PDF/A helper files were successfully uninstalled. **" @echo "***********************************************************" #Solrutils allows automatic installation, running and searching of an external Solr index. install-solrutils: @echo "***********************************************************" @echo "** Installing Solrutils and solr, please wait... **" @echo "***********************************************************" cd $(prefix)/lib && \ if test -d apache-solr*; then echo A solr directory already exists in `pwd` . \ Please remove it manually, if you are sure it is not needed; exit 2; fi ; \ if test -f apache-solr*; then echo solr tarball already exists in `pwd` . \ Please remove it manually.; exit 2; fi ; \ wget http://archive.apache.org/dist/lucene/solr/3.1.0/apache-solr-3.1.0.tgz && \ tar -xzf apache-solr-3.1.0.tgz && \ rm apache-solr-3.1.0.tgz cd $(solrdir)/contrib/ ;\ wget http://mirrors.ibiblio.org/pub/mirrors/maven2/com/jcraft/jzlib/1.0.7/jzlib-1.0.7.jar && \ cd $(solrdir)/contrib/ ;\ jar -xf ../example/webapps/solr.war WEB-INF/lib/lucene-core-3.1.0.jar ; \ if test -d basic-lucene-libs; then rm -rf basic-lucene-libs; fi ; \ mv WEB-INF/lib/ basic-lucene-libs ; \ cp $(solrutils_dir)/schema.xml $(solrdir)/example/solr/conf/ cp $(solrutils_dir)/solrconfig.xml $(solrdir)/example/solr/conf/ cd $(solrutils_dir) && \ javac -classpath $(CLASSPATH) -d $(solrdir)/contrib @$(solrutils_dir)/java_sources.txt && \ cd $(solrdir)/contrib/ && \ jar -cf invenio-solr.jar org/invenio_software/solr/*class update-v0.99.0-tables: cat $(top_srcdir)/modules/miscutil/sql/tabcreate.sql | grep -v 'INSERT INTO upgrade' | ${prefix}/bin/dbexec echo "DROP TABLE IF EXISTS oaiREPOSITORY;" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc ADD COLUMN more_info mediumblob NULL default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK ADD COLUMN priority tinyint(4) NOT NULL default 0;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK ADD KEY priority (priority);" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA DROP PRIMARY KEY;" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA ADD PRIMARY KEY (id);" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA CHANGE id id mediumint(8) unsigned NOT NULL auto_increment;" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA ADD UNIQUE KEY object_name (object_name);" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmPARAMETERS CHANGE value value text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmAPPROVAL ADD note text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE hstDOCUMENT CHANGE docsize docsize bigint(15) unsigned NOT NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtACTIONHISTORY CHANGE client_host client_host int(10) unsigned default NULL;" | ${prefix}/bin/dbexec update-v0.99.1-tables: @echo "Nothing to do; table structure did not change between v0.99.1 and v0.99.2." update-v0.99.2-tables: @echo "Nothing to do; table structure did not change between v0.99.2 and v0.99.3." update-v0.99.3-tables: @echo "Nothing to do; table structure did not change between v0.99.3 and v0.99.4." update-v0.99.4-tables: @echo "Nothing to do; table structure did not change between v0.99.4 and v0.99.5." update-v0.99.5-tables: @echo "Nothing to do; table structure did not change between v0.99.5 and v0.99.6." update-v0.99.6-tables: @echo "Nothing to do; table structure did not change between v0.99.6 and v0.99.7." update-v0.99.7-tables: @echo "Nothing to do; table structure did not change between v0.99.7 and v0.99.8." update-v0.99.8-tables: @echo "Nothing to do; table structure did not change between v0.99.8 and v0.99.9." update-v0.99.9-tables: # from v0.99.9 to v1.0.0-rc0 echo "RENAME TABLE oaiARCHIVE TO oaiREPOSITORY;" | ${prefix}/bin/dbexec cat $(top_srcdir)/modules/miscutil/sql/tabcreate.sql | grep -v 'INSERT INTO upgrade' | ${prefix}/bin/dbexec echo "INSERT INTO knwKB (id,name,description,kbtype) SELECT id,name,description,'' FROM fmtKNOWLEDGEBASES;" | ${prefix}/bin/dbexec echo "INSERT INTO knwKBRVAL (id,m_key,m_value,id_knwKB) SELECT id,m_key,m_value,id_fmtKNOWLEDGEBASES FROM fmtKNOWLEDGEBASEMAPPINGS;" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmPARAMETERS CHANGE name name varchar(40) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc CHANGE docname docname varchar(250) COLLATE utf8_bin NOT NULL default 'file';" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc CHANGE status status text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc ADD COLUMN text_extraction_date datetime NOT NULL default '0000-00-00';" | ${prefix}/bin/dbexec echo "ALTER TABLE collection DROP COLUMN restricted;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK CHANGE host host varchar(255) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE hstTASK CHANGE host host varchar(255) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE bib85x DROP INDEX kv, ADD INDEX kv (value(100));" | ${prefix}/bin/dbexec echo "UPDATE clsMETHOD SET location='http://invenio-software.org/download/invenio-demo-site-files/HEP.rdf' WHERE name='HEP' AND location='';" | ${prefix}/bin/dbexec echo "UPDATE clsMETHOD SET location='http://invenio-software.org/download/invenio-demo-site-files/NASA-subjects.rdf' WHERE name='NASA-subjects' AND location='';" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET name='runoairepository', description='run oairepositoryupdater task' WHERE name='runoaiarchive';" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET name='cfgoaiharvest', description='configure OAI Harvest' WHERE name='cfgbibharvest';" | ${prefix}/bin/dbexec echo "ALTER TABLE accARGUMENT CHANGE value value varchar(255);" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET allowedkeywords='doctype,act,categ' WHERE name='submit';" | ${prefix}/bin/dbexec echo "INSERT INTO accARGUMENT(keyword,value) VALUES ('categ','*');" | ${prefix}/bin/dbexec echo "INSERT INTO accROLE_accACTION_accARGUMENT(id_accROLE,id_accACTION,id_accARGUMENT,argumentlistid) SELECT DISTINCT raa.id_accROLE,raa.id_accACTION,accARGUMENT.id,raa.argumentlistid FROM accROLE_accACTION_accARGUMENT as raa JOIN accACTION on id_accACTION=accACTION.id,accARGUMENT WHERE accACTION.name='submit' and accARGUMENT.keyword='categ' and accARGUMENT.value='*';" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET allowedkeywords='name,with_editor_rights' WHERE name='cfgwebjournal';" | ${prefix}/bin/dbexec echo "INSERT INTO accARGUMENT(keyword,value) VALUES ('with_editor_rights','yes');" | ${prefix}/bin/dbexec echo "INSERT INTO accROLE_accACTION_accARGUMENT(id_accROLE,id_accACTION,id_accARGUMENT,argumentlistid) SELECT DISTINCT raa.id_accROLE,raa.id_accACTION,accARGUMENT.id,raa.argumentlistid FROM accROLE_accACTION_accARGUMENT as raa JOIN accACTION on id_accACTION=accACTION.id,accARGUMENT WHERE accACTION.name='cfgwebjournal' and accARGUMENT.keyword='with_editor_rights' and accARGUMENT.value='yes';" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC CHANGE id id int(15) unsigned NOT NULL auto_increment;" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC ADD external_id int(15) NOT NULL default '0';" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC ADD collection_id int(15) unsigned NOT NULL default '0';" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC ADD original_url text;" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD status char(2) NOT NULL default 'ok';" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD KEY status (status);" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_Photos_to_Storage','Attach/edit the pictures uploaded with the \"create_photos_manager_interface()\" function');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFIELDDESC VALUES ('Upload_Photos',NULL,'','R',NULL,NULL,NULL,NULL,NULL,'\"\"\"\r\nThis is an example of element that creates a photos upload interface.\r\nClone it, customize it and integrate it into your submission. Then add function \r\n\'Move_Photos_to_Storage\' to your submission functions list, in order for files \r\nuploaded with this interface to be attached to the record. More information in \r\nthe WebSubmit admin guide.\r\n\"\"\"\r\n\r\nfrom invenio.websubmit_functions.ParamFile import ParamFromFile\r\nfrom invenio.websubmit_functions.Move_Photos_to_Storage import read_param_file, create_photos_manager_interface, get_session_id\r\n\r\n# Retrieve session id\r\ntry:\r\n # User info is defined only in MBI/MPI actions...\r\n session_id = get_session_id(None, uid, user_info) \r\nexcept:\r\n session_id = get_session_id(req, uid, {})\r\n\r\n# Retrieve context\r\nindir = curdir.split(\'/\')[-3]\r\ndoctype = curdir.split(\'/\')[-2]\r\naccess = curdir.split(\'/\')[-1]\r\n\r\n# Get the record ID, if any\r\nsysno = ParamFromFile(\"%s/%s\" % (curdir,\'SN\')).strip()\r\n\r\n\"\"\"\r\nModify below the configuration of the photos manager interface.\r\nNote: \'can_reorder_photos\' parameter is not yet fully taken into consideration\r\n\r\nDocumentation of the function is available by running:\r\necho -e \'from invenio.websubmit_functions.Move_Photos_to_Storage import create_photos_manager_interface as f\\nprint f.__doc__\' | python\r\n\"\"\"\r\ntext += create_photos_manager_interface(sysno, session_id, uid,\r\n doctype, indir, curdir, access,\r\n can_delete_photos=True,\r\n can_reorder_photos=True,\r\n can_upload_photos=True,\r\n editor_width=700,\r\n editor_height=400,\r\n initial_slider_value=100,\r\n max_slider_value=200,\r\n min_slider_value=80)','0000-00-00','0000-00-00',NULL,NULL,0);" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Photos_to_Storage','iconsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFIELDDESC VALUES ('Upload_Files',NULL,'','R',NULL,NULL,NULL,NULL,NULL,'\"\"\"\r\nThis is an example of element that creates a file upload interface.\r\nClone it, customize it and integrate it into your submission. Then add function \r\n\'Move_Uploaded_Files_to_Storage\' to your submission functions list, in order for files \r\nuploaded with this interface to be attached to the record. More information in \r\nthe WebSubmit admin guide.\r\n\"\"\"\r\nfrom invenio.websubmit_managedocfiles import create_file_upload_interface\r\nfrom invenio.websubmit_functions.Shared_Functions import ParamFromFile\r\n\r\nindir = ParamFromFile(os.path.join(curdir, \'indir\'))\r\ndoctype = ParamFromFile(os.path.join(curdir, \'doctype\'))\r\naccess = ParamFromFile(os.path.join(curdir, \'access\'))\r\ntry:\r\n sysno = int(ParamFromFile(os.path.join(curdir, \'SN\')).strip())\r\nexcept:\r\n sysno = -1\r\nln = ParamFromFile(os.path.join(curdir, \'ln\'))\r\n\r\n\"\"\"\r\nRun the following to get the list of parameters of function \'create_file_upload_interface\':\r\necho -e \'from invenio.websubmit_managedocfiles import create_file_upload_interface as f\\nprint f.__doc__\' | python\r\n\"\"\"\r\ntext = create_file_upload_interface(recid=sysno,\r\n print_outside_form_tag=False,\r\n include_headers=True,\r\n ln=ln,\r\n doctypes_and_desc=[(\'main\',\'Main document\'),\r\n (\'additional\',\'Figure, schema, etc.\')],\r\n can_revise_doctypes=[\'*\'],\r\n can_describe_doctypes=[\'main\'],\r\n can_delete_doctypes=[\'additional\'],\r\n can_rename_doctypes=[\'main\'],\r\n sbm_indir=indir, sbm_doctype=doctype, sbm_access=access)[1]\r\n','0000-00-00','0000-00-00',NULL,NULL,0);" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Uploaded_Files_to_Storage','forceFileRevision');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Create_Upload_Files_Interface','Display generic interface to add/revise/delete files. To be used before function \"Move_Uploaded_Files_to_Storage\"');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_Uploaded_Files_to_Storage','Attach files uploaded with \"Create_Upload_Files_Interface\"')" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','elementNameToDoctype');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','createIconDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','createRelatedFormats');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','iconsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','keepPreviousVersionDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_Revised_Files_to_Storage','Revise files initially uploaded with \"Move_Files_to_Storage\"')" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','maxsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','minsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','doctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','restrictions');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canDeleteDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canReviseDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canDescribeDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canCommentDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canKeepDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canAddFormatDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canRestrictDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canRenameDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canNameNewFiles');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','createRelatedFormats');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','keepDefault');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','showLinks');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','fileLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','filenameLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','descriptionLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','commentLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','restrictionLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','startDoc');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','endDoc');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','defaultFilenameDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','maxFilesDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Uploaded_Files_to_Storage','iconsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Uploaded_Files_to_Storage','createIconDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Report_Number_Generation','nblength');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Second_Report_Number_Generation','2nd_nb_length');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Get_Recid','record_search_pattern');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_FCKeditor_Files_to_Storage','Transfer files attached to the record with the FCKeditor');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_FCKeditor_Files_to_Storage','input_fields');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Uploaded_Files','layer');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Replace_Single_File_Approval','layer');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Replace_Single_File_Approval','switch_file');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Uploaded_Files','switch_file');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Files_to_Storage','paths_and_restrictions');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Files_to_Storage','paths_and_doctypes');" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD round_name varchar(255) NOT NULL default ''" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD restriction varchar(50) NOT NULL default ''" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD in_reply_to_id_cmtRECORDCOMMENT int(15) unsigned NOT NULL default '0'" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD KEY in_reply_to_id_cmtRECORDCOMMENT (in_reply_to_id_cmtRECORDCOMMENT);" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD in_reply_to_id_bskRECORDCOMMENT int(15) unsigned NOT NULL default '0'" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD KEY in_reply_to_id_bskRECORDCOMMENT (in_reply_to_id_bskRECORDCOMMENT);" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD reply_order_cached_data blob NULL default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD reply_order_cached_data blob NULL default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD INDEX (reply_order_cached_data(40));" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD INDEX (reply_order_cached_data(40));" | ${prefix}/bin/dbexec echo -e 'from invenio.webcommentadminlib import migrate_comments_populate_threads_index;\ migrate_comments_populate_threads_index()' | $(PYTHON) echo -e 'from invenio.access_control_firerole import repair_role_definitions;\ repair_role_definitions()' | $(PYTHON) CLEANFILES = *~ *.pyc *.tmp diff --git a/NEWS b/NEWS index 93f1676fe..04319a90c 100644 --- a/NEWS +++ b/NEWS @@ -1,2043 +1,2713 @@ Invenio NEWS ============ Here is a short summary of the most notable changes in Invenio releases. For more information about the current release, please consult RELEASE-NOTES. For more information about changes, please consult ChangeLog. +Invenio v1.2.0 -- released 2015-03-03 +------------------------------------- + + *) BatchUploader: apache error codes; insert or replace mode; + authorize via CIDR; add holdingpen directory; several + improvements; bibtask logs via email (#1255); multiple + improvements (#603); fix for permission checking (#1747 #1748) + + *) BibAuthorID: user prefs and session fix; inactivation of + test_save_matrix() (#1678); merge and manage fixes; caches badly + stored in user settings; fix 'create new person' ticketing issue; + leftover print statement; disables debug output; Claiming page is + now reloaded after commit.; hepnames match; + add_cname_to_hepname_record(); hotfix in name comparison; remove + changes tempfile.rootdir; graceful external system query; adds + webuser user merge utility; fix arXiv redirect link; improvements + and bug fixes; improvements and bug fixes; DOIs from ORCID check; + WaP daemon and BAI interface fixes; fix in templates handlers; + hotfixes for authorpages and webauthorprofile daemon; Help pages + and messages; a new hope; use defaultdict from containerutils + + *) BibAuthority: new names for authority collections; source file + mode fix; separate Authorities collection (#1605); initial release + (#1602); fix for unit test suite + + *) BibCatalog: ticket_id type is now string (#2096); better error + reporting; requestor on ticket submit; ticket_submit() docstring + update (#2094); improve RT search error handling; return empty + list if no search params; RT discovery; email content cleanup; bug + fix; pylint fixes; refactoring; adds bibcatalog bin to ignored + files; add daemon task (#1528); default email backend (#872); new + email ticketing backend (#872) + + *) BibCheck: $$9 bibcheck to DOIs (#1955); improvements in DOI checks + (#1955); allow filtering by subfield contents (#2474); last_run + correct update; properly cumulates records; compatiblity with + dateutil 2.2; improve url plugin and tasklet; improve url plugin; + adds --config option; improve exception handling crossref queries; + add retry download to crossrefutils; improve doi plugin; avoid + checking dummy records; add option to consider deleted records; + new BibCheck module + + *) BibCirculation: library creation and other fixes (#2550 #2551 + #2552 #2562 #2373); fix for CERN returnees; fix for typo; missing + web tests; minor spelling error fix; fix for mandatory library + type (#1519); email ID changes and test fixes (#1479); admin guide + cleanup; patron-driven acquisition and more (#1280); personid CERN + attribute; ILL improvement; CERN LDAP improvements (#1186); set + colour of some buttons; fix for ILL title and request type; fix + for library ID variable name; various updates; fixed notes link; + code cleaning; better ill/purchase search; auto-fill for purchase + request; remove reference to apache_user; optimize CERN LDAP + query; temporary barcode for new copies; extended ILL to manage + acquisition; make statuses customizable; lots of small fixes; + 'cancelled' status for ILL request; sorting last issued loans; + edit ill request details; loan and renew process enhancement; + added budget_code to crcILLREQUEST; edit library type; arrival + date and library merge; extended item statuses; improved + book_title_from_MARC; fixed multi-barcode loan; fixed user + interface loan renewal; pylint and kwalitee cleaning; small fixes + on printing & intrface; daemon for overdue letters; email alerts + for new requests; delete a copy of a book; added CERN id in + borrower profile (#207); use new URL handler for admin pages; + avoid multiple loan creation (#305) + + *) BibClassify: ontology cache check improvement (#2672); always use + invenio code; raises an exception if rdflib is missing; unit tests + temp dir fix; remove ability to run as standalone (#1459) + + *) BibConvert: lxml support for local document() (#2497) + + *) BibDocFile: pickle support fix (#2549); decompose_file_url() and + subformat (#2556 #2557); bibdocfile.BibDoc memory fix (#2082 + #2136); change name failure raises exception (#2071); more robust + decompose_bibdocfile_url() (#1957); escape file URLs in /files tab + (#2067); fix type of bibrec-bibdoc connection (#1759); get_icon() + for smallest size icon (#1350 #1743); undefined variable fix; + register downloads with recid (#1831 #1832); new web tests; + bibdocmoreinfo query typo fix (#1706); textification with OCR fix + (#1676); get_file() exact_docformat support; display counts in + tabs; fix "delete" CLI option; no access to filesystem; preferred + extension (#1619); load plugins at global level; migration script + fix; fixes wrong variable name; error reporting changes; CERN AFS + awareness (#1388); retry mkstemp in case of failure; CERN AFS + awareness (#1388); fix for bibdoc unattached to record (#1551); + improve BibDoc display in Files tab; raise exception in + _build_file_list(); additional mimetypes support; fix version in + register_download() (#1532); fix for BibDocFile instantiation + (#1317); implements format renaming (#1318); allow doctype + renaming (#980); revert md5 property patch (#1249); new document + data model; fix for display of hidden icons; change_name missing + parameter fix (#1818) + + *) BibEdit: only notifications on error; kwalitee improvements; add + email notification on submit; user name in BibSched column; + wrongly displayed HP changeset bug; autocompletion of fields from + KBs (#1258 #73); author names into history revisions; duplicate + code removal; new RT ticket through UI dialog; int object is not + iterable fix; InvalidCache exception on clone; modal submission + preview window; check for record in BibSched queue fix; debugging + all user actions; holding pen fix; prevent deletion of managed + DOIs fields (#1445); fix revert when no 005 in history; Holding + Pen fix; add AJAX profiling option; adds affiliation guessing; + bibHOLDINGPEN from TEXT to longblob; bibupload xml file path + conflicts; support for simple ticketing; small merging fix; + BibEdit web test improvements.; fix textmarc2xmlmarc unit test; + record from history instead of bibfmt; BibCatalog and other + improvements; fixes errors in case of deleted records; several + bugfixes; moves files cache to the database; open DOI source in + new window; fixes pdf detection; several improvements; HoldingPen + multiple improvements; update + CFG_BIBEDIT_EXTEND_RECORD_WITH_COLLECTION_TEMPLATE; fixes date + parsing problem; hide authors when they exceed max number; + multiple fixes and improvements (#1190); send latest timestamp + when reverting; update admin help page and shortcuts; remove extra + holding pen call; show/hide specific parts of the record; merge + record with template; custom errors for AJAX requests; better + holdingpen integration (#87); tab switch between fields; minor + fixes; fix perform_doi_search function; refactoring and fixes; use + perform_request_search on search; add version to bibedit css name; + sort HoldingPen changes alphabetically; add direct link to + dx.doi.org; save changes periodically; avoid sync request to see + if record has pdf; change cache folder; amend textmarc to xmlmarc + unit test (#1269); import CrossRef data; improvements and fixes + (#761 #1032); css changes; allow opening deleted records (#573); + delete cache if record not modified; add extraction of references + from URL; several fixes; introduce textmarc editor; cnum + generation on conference records; multiple improvements (#696); + revert to master version (#792 #63 #118 #125); fix return binding + on Jeditable cells; fix jEditable callback when pressing return; + fix input default value; disable preview button when reverting + record; fix jEditable callback when pressing return; hide delete + record button by default; add field in specific position (#583); + fix apply all HP changes (#125); clean JavaScript code (#63); + extract css into a separate file (#118); upgrade to jQuery 1.5 + + *) BibEditMulti: only notifications on error; add email notification + on submit; adds support for hidden fields (#707); allow non- + delayed processing and priority change; several improvements; + display all MARC fields (#1489); fix for multilanguage interface + (#1331); multiple improvements and fixes (#1146 #1147 #1148 #1130 + #1149 #1156 #1158) + + *) BibEncode: support for FFmpeg >= v0.9; updated for latest + BibDocFile APIs; fix uuid Python 2.4 compatibility (#1478) + + *) BibExport: update Google Scholar exporter; hidden files and + recrawling + + *) BibField: new CFG_BIBFORMAT_HIDDEN_RECJSON_FIELDS (#2197 #2396); + better create_record error catching (#2510); fix copyright field + names (#1933); backported improvements from pu (#1687); no caching + of calculated fields; change recid field type to integer (#1633); + improvements backported from next; fix number_of_copies field + (#1625); new upgrade recipe to remove json cache; new field + filtering for `get_record`; elimination of None values in recjson; + `schema` in `split_blob`; `is_empty` update; fix for '__eq__' to + better compare recs; fix for `is_type_isbn`; continuable vs fatal + errors; bibdoc integration; new decorator @only_if_master_format; + better handling of calculated fields; fix for misbehavior when + parsing rules; new producer section added to config; clean up of + atlantis.cfg demo file (#1557); volume subfield addition; creation + date addition and keyword fix; new fft field in `atlantis.cfg`; + Python-2.4 compatibility fix (#1533); legacy_export_as_marc + escaping fix (#1509); new calculated fields; virtual field aliases + amended (#1530); new @persistent_identifier "decorator" (#1500); + bug fixes when using decorators (#1502); fix for lxml + compatibility; Python-2.4 compliance; initial release (#1300) + + *) BibFormat: new BFO for authority records (#1699 #1749); links to + public resources of authors (#1700 #1749); better display of + authority records (#1749 #1699); ORCID display for authors; + removal of obsolete BFX engine (#2563 #2124); recjson update using + bibreformat (#1708 #2220); PEP8 fixes in bibreformat (#2220); add + sponsor information to copyright (#1975); larger column + `format.code` (#2072); advertise /doi URL in DC output; improve + Dublin Core output (#320 #1213); configurable /record; new + bfe_oai_identifier element; new bfe_date parsing/formatting + options; plot file identification improvements (#1514); fix for + eval_format_element return type; file rights fix; new + bfe_arxiv_link; affiliation improvements; left over print in + format_record; reworks exceptions handling; only save default site + lang on the fly; look for missing caches by default; fix snippet + generation; needs_2nd_pass in bibreformat; duplicate code in + bibreformat.py; improves and updates bfe_plots; fixes tests; fix + external function for libxslt; improve Google Scholar support + (#1513); Displays the DOI in the EndNote; dublin core export now + includes DOI; to fixup to removes old php format; small fixes; + several fixes; fix in date comparison; second formatting pass + (#1464); lazy missing formats updates; empty record check; + progress display improvement; initial example of Twitter Card + support; fix for snippet generation; author links for mobile app; + initial release of mobile app formats; new Solr fulltext snippet + facility (#1301); QR-code format element (#1441); add DataCite XSL + stylesheet; remove 0248_a field from title; fixes last run date + for HDREF (#1236) + + *) BibIndex: ambiguous SQL query fix for MariaDB-5.5 (#2759); + tag.recjsonvalue NOT NULL (#1947 #2259); fix new-old record + incremental indexing (#2693); clean up after authority regression + test (#2448); author ID performance improvements (#1952); upgrade + recipe for `tag.recjson_value`; recjson fields in admin interface; + indexing non-MARC standards; abstraction layer for terms + retrieval; WordTable API changes; move helper functions to utils + file; changes in WordTable argument list; PEP8 compliance fixes; + fix for virtual index filtering; new DOI index (#1655); virtual + index queue dupe optimisation; new 'all-virtual' CLI option; minor + engine refactoring; documentation for virtual indexes; new pattern + for tokenizer inheritance (#1704); new abstract class for indexes; + separate class for virtual index (#1661); common words in virtual + index (#1653); fixes admin regression tests; + BibIndexDefaultTokenizer upgrade; bad word check optimized; + consistency check optimizations (#1436); ingestion health and + "unneeded" indexes (#1632); index type in admin interface; virtual + global index (#1574); indexing only affected indexes (#1573); + clean warning messages in test suite (#1615); filetype and + itemcount tokenizer fix (#1609); new index 'filetype' (#473); new + index 'itemcount'; tokenisation of authority records; fix syntax + error in bibstat; support for CJK languages (#285); pluginutils + for tokenizers (#852); centralisation of tokenizers (#852); new + regression tests; centralisation of LaTeX/HTML treatment (#852); + centralisation of stopword treatment (#852); centralisation of + synonym treatment (#852); fix for external fulltext indexing; + rework of error handling (#1075); move of text extraction to + BibDocFile; new exacttitle index (#1397); new filename index + (#1717) + + *) BibKnowledge: searchtype parameter in KB export (#2570 #2581); fix + get_kbt_items_for_bibedit (#1879 #1895); lxml port + get_kbt_items_for_bibedit + + *) BibMatch: allow tests to login over plain http; Fix validator + problem; use other author comparison function; more print + statements; improves get_longest_words; improve fuzzy queries; + validation fixes + + *) BibMerge: adds CFG_SITE_RECORD as script data (#2580 #2237); + `onclickSubmitButton` missing comma fix (#2230); prevent loss of + DOI when merging records (#1446); delete cache of master record + before submission; change order of updates; add subfield sorting + and interface fixes; several fixes; add 981__a field to master + record; delete duplicate record first (#1645) + + *) BibRank: fix path for download history graph (#2554 #2374); fix of + similar-to-recid result order (#1745 #2236); missing selfcites for + collaborations; record ID citations catchup; citation blobs in + Redis (#1689); adds a new option to disable bibsort (#1617); minor + refactoring in word ranking; handle missing files when removing + graphs; more leanient date handling in citation graphs; more + leanient date handling in citation graphs; remove outdated import + in citations tab; exception when gnuplot is not available; unicode + recid in citation indexer; Added ISBN, recid and HBL identifiers; + fix bad variable name; fixes for sorting; missing drop table + rnkSELFCITEDICT; new way to generate graphs (#1244); consider only + one year in citation graph; fixes for cited by sort; function to + get citations of a single record; fixes sorting; optimized cited + by sorting; filter citations on collections (#1504); logging of + citation changes (#1426); store selfcites in a table (#1417); + citesummary optimizations (#1481 #1217); handle records with + mulitple journals (#1394); optimized cited by sorting; no citerank + error when no citations (#1624); better Solr regression tests; + faster Solr indexer; new multi-tag Solr indexer; index latest + records first in Solr; increase rnkDOWNLOADS.file_format size; + self cites upgrade recipe improvement (#1482); detect external + word similarity ranker; storing citation indexer warnings in DB + (#1210); optimisations in citation algorithm (#1073); selfcites + fixes; fix for citation indexer checks; citation indexer sanity + checks and alerts (#1091); reference linking improvements (#950); + citation indexer date check change (#946); fix for missing Python + files in Makefile; two algorithms for self-citations (#945); + change import to defining module; better exception handling in + Solr indexer (#1199); better default mode in Solr indexer (#1192); + more invalid Solr character replacements; new Solr and Xapian + ranking bridge (#1084 #1168) + + *) BibRecord: namespaces ignored for lxml (#2604); search & compare + subfields; new API records_identical(); new API + identical_records(); record_get_field_values with filtering + (#1550); filter field instances (#1550) + + *) BibReformat: chunking of updated records query + + *) BibSched: email-logs-on-error parameter (#2205); check schSTATUS + when detecting status; pep8 for bibtask.py; pep8 for bibched.py; + subdirs for bibsched logs; fixes a bug with --profile cli option; + fix priority for the same sequence id; increase max log file size + to 5Mb; display mode for non-periodical tasks; adds more task + changing commands; get_modified_records_since() (#1538); monitor + auto mode selection bug; invalid sql in monitor history tab; + setting to continue on errors; many improvements (#1177 #991); + error when switching to manual; refactoring and improvements + (#1274 #1275 #1449); enhanced write_message(); motd update check; + problem parsing task CLI options (#1330); interface responsiveness + improvements (#1303); priority in automatic mode; CLI-started + tasks host field; kwalitee fixes; shell output leakage upon task + kill (#1343); single error reporting (#1342); scheduling algorithm + improvements (#1281); fixes task chain-sleeping (#1304); fixes + monotasks for multi-node (#1304); fixes for multi-node setup + (#925); new --email-logs-to bibtask CLI (#1252); subprocess + instead of deprecated popen2; new web UI for BibSched live view + + *) BibSort: improved washers (#2283 #1754); add check before + deleting; fix typos and CLI arguments + + *) BibUpload: creation_date based on incoming 005 (#2693 #1604 + #2684); faster recjson deletion after updates (#1708); no reload() + in regression tests (#1702); --append only new fields (#1440); + removed print statement; do not always process MoreInfo; + CFG_BIBUPLOAD_EXTERNAL_OAIID_TAG fix; new + CFG_BIBUPLOAD_MATCH_DELETED_RECORDS (#1438); affected fields and + insert mode; 8564_s support; less useless computation; less + verbose; messages cleaning; ingore 856 tag order in conflict + (#1606); smarter conflict report; smarter conflict detection; no + tickets in pretend mode; ticket creation fix; improves utf-8 + checks; task error messages (#1449); utf-8 encoding; encoding + checks; regression tests cleanup; matching existing records + (#1438); pretend holding pen fix (#1618); fill affected_fields in + hstRECORD (#1572); fix for inserts with 005 (#1595); conflicting + revision ticket queue; smart record uploader fixes; BibCatalog + connection; sensible history and other goodies (#498 #1250 #871); + bibrec timestamp bug (#1431); smart record uploader (#816 #864 + #897); check DOI uniqueness (#1160) + + *) DocExtract: new CMS PAS report numbers; additional report numbers; + extract page-end from references; removes stdout ouput from tests; + rework of regression tests; fixes regression tests; improves + bibrecord; increases compiled regexp cache size; preload + docextract author regexp; using -i instead of -r; preload kbs on + wsgi load; re-enable caching of kbs; outdated import in webtool; + reduce verbose in tests; fixes DESY-THIS rn recognition; 5 digits + arxiv numbers detection; do not create old tickets; lower + bibupload priority; webinterface text box fix; optional unidecode + dependency; help messages & compatibility warnings (#1220); + several improvements; move mislabelled regression tests (#1309); + journal rawref search fix (#1306); nose-friendly refextract tests; + fix reference extractor unit tests; refextract unit tests file + name fix; preparing for merging into master; multiple fixes (#966 + #958); new docextract and refextract modules (#944 #1014) + + *) HepData: updates to formats; fixes unit tests; clean hepdata.js + inclusion; new HepData module; adds hepdataharvest bin to ignored + files + + *) HepNames: update form migrated to INSPIRE + + *) I18N: PO file update for the release of v1.2.0; more complete + POTFILES.in; fix wrong msgids in Persian translation; updates to + the Persian translation; POTFILES.in update; initial Persian + (Farsi) translation; infrastructure for Persian (Farsi); several + fixes in Spanish translation; Catalan and Spanish updates to + Search Guide; Catalan and Spanish updates to Search Tips + + *) InvenioConnector: allow logins over plain http; fix for CDS + authentication + + *) OAIHarvest: fix identifier parsing (#2408); conversion argument + name upgrade (#1753); error reporting fix (#1804 #1812); respect + hidden fields; do not launch BibIndex when done; bibindex priority + to 4; only update lastrun on successful harvest; small daemon + enhancement; fixes missing import; priority of single harvest + tasks; improves arXiv identifier harvesting; several improvements + (#547); sample OAI-ArXiv conversion update (#678); CERN-specific + "arXiv" doctype; consider source_id for selective post-processing; + configurable selective post-processing (#1477) + + *) OAIRepository: lower priority to updating uploads (#2525); fix for + hidden OAI tags (#2642); more lenient time limit for tests; do not + report cache not found errors; allows running slow machine; + oai_get_recid() for merged/deleted records (#1429); marcxml + created in shared directory; forcing clients to re-harvest (#1218) + + *) PdfChecker: clean up after regression tests (#2448); log full list + of updated recids; skip records without unique ids in 037 tags; + new module for arxiv pdf checker + + *) RefExtract: avoid double encoding (#2602); refactored book + handling; improved book search; addresses warning in tests; + removes leftover print; only accpet digits as numeration; allows + more lines between title and numeration; changes condition for + ticket creation; improves docextract, refextract + + *) SolrUtils: fix of similar-to-recid result order (#1745 #2236); + better exception handling in indexers; faster snippet factility; + support entire full-text indexing; cleaner schema.xml; support + high count of logical clauses + + *) WebAccess: automatically fetch SSO nicknames (#2583); CERN- + specific authorization message; fixes user details page links; + CFG_ACCESS_CONTROL_LEVEL_SITE=1 support (#1501); remove Facebook + testing credentials; update check for "external" account at CERN; + ORCID support (#1124); OpenID and OAuth authentication (#1124); + new CERN auth method support + + *) WebAlert: update tests for newly introduced records + + *) WebApiKey: unit Vs. regression tests + + *) WebAuthorList: fix import from recid; fix import from record id; + ignore empty affiliations when exporting; add new author list + manager tool + + *) WebAuthorProfile: reenable profile pages; disable if not + available; compatiblity with atlantis; fixes unit tests; recompute + link as a post action; new regression test suite + + *) WebBasket: 'move item' improvements; new 'move item' functionality + (#1547); Create Basket link in the main display (#1333); correct + referer when adding to basket (#1194); fix copying external items + + *) WebComment: fix for get_first_comments_or_remarks (#2522 #2523); + more prominent subscription link (#2434); deleted record message; + "Your Comments" page; link to "Your Comments" after posting; "Your + Comments" page (#974) + + *) WebJournal: Indico seminars widget improvement (#1980 #1981); fix + image dimension retrieval; sample Twitter Card markup; new image + template; better exception handling when caching; structured cache + (#1544); CERN-specific fix; fix for what's new widget test case + + *) WebLinkback: safer notification email; clean regression test suite + (#1285); fix for importing CFG_DATABASE values; pending linkback + notification emails (#1247); minor improvement; better + documentation; module optional (#1245); better global /linkbacks + page; better /linkbacks tab display; better URL title display; fix + for DB name in regression tests; fix for user_info passing; unit + test module rename; auto-increment regression test fix (#1136); + initial release (#627 #857 #1136); fix truncated FSF address in + docstring + + *) WebMessage: English corrections in output messages (#1849) + + *) WebSearch: optional refersto/citedby record limit (#2711); removal + of hard-coded Holdings tab (#2592 #2664); new test case for + pattern-limit queries (#1750 #1751); search results pattern limit + fix (#1750 #1751); proper re-raise in RSS handling (#2084 #2598); + fix for the number of printed records (#2512); inverted collection + scores (#2058); stemming and '*' (#2468); smarter journal hint + (#2352); new Journal Hint Service (#2352); kwalitee fix (#2352); + richer `/record` and `/search` API docs (#2303); fix for record + numbering in pagination (#1762 #1763); new Add-to-Search Interface + (#622 #271 #1738); CERN-specific video latest additions (#2068); + CERN-specific lecture latest additions (#2068); improve detection + of record owners (#2068); better retrieval of record tabs (#2068); + fix IndexError in is_hosted_collection (#1764); CERN-specific hack + for latest additions (#1976); CERN-specific collection sorting + (#2017); fix for 'rhs is of unknown type' (#1819); resolve + (internal) DOIs (#1322); anyfield in CFG_WEBSEARCH_SYNONYM_KBRS + (#1493); faster collection children cache (#1739); initial support + for recjson output; fix detailed record page tab tracebacks; + update collection page markup; fix search URL in timeout message; + CERN-specific collection sorting; better sort order in citation + tabs (#1307); timestamp detection fix for empty sites; sorting + fixes (#1674); reverse order and scores; rg parameter with + of='id'; reworks async downloader; wgsi.errors in fake request; + handle case in /collections/ urls; fixes + regression tests; stdout.flush conflicting with mod_wsgi; changes + citation tab count; search API changes for record sorting (#1657); + fix sorting options (#801); spires date parsing errors fixes; no + 'back to search' on empty session; display deleted records in + citation log; make query parser use Invenio datetime; fix mixed + parameter for re.sub(); bibfmt on innodb; outdated import in + citations tab; takes into account new record in tests; fix HepData + templates; change CFG_SITE_URL to CFG_BASE_URL; fixes search bug + with --empty hitset; add cataloguer: search unit; SPIRES date + format 11/93; change CFG_SITE_URL to CFG_BASE_URL; testing fixing + subject lookup; add record edit link in brief; pep8 fixes; INSPIRE + vol to use volume field; INSPIRE texkey in 035__%; handles + selfcites searches; spires syntax and quotes; INSPIRE fulltext + warning update; find doi in search engine (#1051); CV output + formats (#314); correct record sums from hosted colls (#1651); + search services (#1278); custom i18n collection boxes (#1286); + item count regression test activation; fix for hidden-field admin + access test; support for intbitset output format (#1460); fix + missing cc info in req object; CERN-specific hack update; display + number of hits in mobile output; Greek translation of Search + Guide; fix Python 2.4 syntax error; most popular field values + optimisation (#1096); fix Search Guide reformatting; fix Search + Guide mismatch tags; Search Guide reformat and pretty-print; fix + browsing deleted/restricted records (#1292); webcoll performance + improvements; permitted restricted colls for guests; empty unit + test suite for summarizer; removal of excess summariser tests; + revamping of citesummary pages (#134); summarizer unit test + update; fix searching with limits; enforcement of record view + restrictions; translation-friendly overview box; restricted record + search improvements; fix for regression test link targets; fix for + double display of the footer; better restricted collection search + (#1161); "p=el*;rm=citation" test inactivation (#1174); sorting + test amendments; mixed ranking/sorting test amendments; wildcard + limit parameter is 0 in p_r_s; bugfix for empty set sorting; + refactored perform_request_search() (#542); add regression tests + for "em" parameter; add "em" parameter; include 'cc' in RSS + 's (#2013 #2014); fix for "--language" option + (#1399 #2219) + + *) WebSession: no differentiation between guests (#2786 #2813); CSRF + token in profiling settings (#1855); disable ORCID login (#1667); + user preference to enable profiling; new Redis session storage + backend (#1688); fixes session_cleanup; session_param_get() + default value (#1294) + + *) WebStat: fix for custom query summary graph (#2553 #2375); default + query in the Custom query summary (#2388); list link fix for + system health UI page (#1713); ingestion health monitor fix + (#1631); use Invenio instead of CDS in pages; new ingestion + monitor (#936); no wildcard limit for custom summary data; add + bibcirculation config variables + + *) WebStyle: richer documentation on record page tabs (#216); ping + handler returning 200 status code (#2700); POST handling fix + (#1951); req object with no headers; fix gotoadmin CLI parmeters + parsing (#1427); move charset higher in the document; move of lang + and dir attributes to html; fixes for /goto CERN-HR plugin + example; silence client disconnected errors; blocking read in + handle_file_post; add missing icons to Makefile; + WebInterfaceDisabledPages(); quote canonical and alternate URLs + (#1515); /info pages using webdoc infrastructure; more accurate + "Restricted" flag display (#867); inactivate two regression tests + (#1293); goto engine typo fix; canonical and alternate URLs (#1251 + #368); new /goto URL handler (#1178); memory leak fix in session + handling (#571) + + *) WebSubmit: Set_Embargo optional and functional (#2699); link to + successfully created record (#1641); more robust JavaScript check + (#1741); print white space instead of None (#1741); support for + elements' custom_level (#1741); `test_revise_picture_admin` test + fix (#2142); `deferRelatedFormatsCreation` param fix (#2142); + Link_Records error message fix (#1734); fix access restrictions in + /uploadfile (#1703 #2066); allow record owners to upload files; + allow image conversion of .tiff (#1909); grant access to the + superadmin as owner (#2065); doilookup function in webinterface + (#2025); guests support improved in /direct URL (#1240); rotate + created icons according to EXIF (#1516); web tests for DEMOART and + DEMOPIC; DEMOART uses bibdocfile_managedocfile; skip pdf + optimization if pdfopt is missing; fixes for openoffice handling; + INSPIRE specific amendments; add traceback info on error; new + Run_PlotExtractor function (#1506); source file mode fix; login + offer to guests on action page; fix for icon creation for + bibdocfiles; jquery-ui update for photo submission + + *) containerutils: new Python-2.4 defaultdict + + *) crossrefutils: new Fundref-based APIs + + *) dataciteutils: refactor DataCite API wrapper (#1457); DataCite DOI + support and test cases + + *) dateutils: adds __add__ to our custom datetime; strptime for + Python-2.4 compatibility; fix for strftime() function; consolidate + localtime_to_utc; day ranges; fix for unit test suite; new + get_time_estimator function + + *) dbdump: partial dumps; ignore with regexp (#579); dump on detached + slave (#1282); fix compress mode; add option to ignore tables; add + slave support; improve error handling + + *) dbquery: fix for importing CFG_DATABASE values; more reinstall- + friendly dbquery + + *) demo site: fix double 245 MARC field + + *) docker: more complete configuration + + *) errorlib: Sentry logging improvements (#2535 #2546); tags context + fix for sentry (#2623); fix Sentry context syntax issue (#1960 + #2147); context support in sentry (#1960 #2147); support for + Sentry logging (#1726); makes SMS messages shorter; time + independent tests; hostname in error notifications (#1546); wrap + warnings to invenio.err (#1616) + + *) filedownloadutils: add verbose to download_url(); utility for file + retrieval (#1076) + + *) general: new CFG_SCOAP3_SITE flag; optional remote debugger; test + fixes; Propagating exceptions in debug mode; unit-tests fixes + + *) git: ignore KDevelop4 project files + + *) global: PEP-8 style in block comments (#1904); test suite original + modification date fix (#2737); removal of INSERT DELAYED SQL + statements (#2268 #2269); removal of leftover files; + InvenioTestCase in test suite (part 2); InvenioTestCase in test + suite; cdsweb.cern.ch becomes cds.cern.ch + + *) htmlutils: render MathML by MathJax; improve js string escaping + + *) importutils: fix None values error; Makefile clean up; Python 2.4 + support and test case; initial release + + *) installation: new release_1_2_0 upgrade recipe; + 2015_03_03_tag_value upgrade recipe; 2013_09_16_aidPERSONIDDATA + fix; 2014_08_12_format upgrade recipe fix; all upgrade recipes in + tabcreate (#1753); richer uninstall-jquery-plugins (#2418); + python-twitter requirement update (#2015); lxml recommended; + location of demo_table_jui.css; location of jquery.omniwindow.js; + location of jquery.blockUI.js; location of sly.min.js; location of + parsley.js; Redis and Nydus pre-requisites; jinja2 prerequisite + (#1677); move h5py to extra requirements; h5py requirement clean- + up; update to MathJax-2.3; add h5py dependency; use custom faster + jeditable; ColVis.js on invenio-software.org; table creation fix; + Python-2.6 and pip requirements; fix for BibAuthority upgrade + recipe; fix for rnkDOWNLOADS upgrade recipe; help for BibAuthorID + email settings; support for Apache-2.4 (#1552); help for `--load- + bibfield-conf` step; oaiREPOSITORY_last_updated upgrade; fix for + table drops and upgrades; selfcites upgrade recipe add-on; more + gentle idxINDEX.indexer recipe; maint-1.1-to-master upgrade recipe + (#1198); fix for 2012_10_29 upgrade recipe; fix for duplicate /css + alias + + *) intbitset: initialization from iterator (#1698); no crash when + intbitset is on rhs (#1287); atomic installation; union() and + isdisjoint() support; type checking for operators + + *) inveniocfg: adds option to failt tests on first error; restore + wrapping showarning after running unit tests; do not capture + warning in unit tests; workaround bibfmt corruption; fixes + BibSched check in upgrader; new derived config CFG_BASE_URL + + *) inveniogc: guest users gc optimization (#428 #1950); clean up gc + tasks (#1950); delete refextract logs after 7 days (from 28); + BibEdit related improvements.; add new session deletion mode; + delete BibEdit temporary files + + *) kwalitee: even stricter PEP-8 compliance + + *) mailutils: better email header type detection (#2713); support + invalid senders (#2256 #2385); fix for send_email() error on DEV + site (#1744); extend send_email with BCC option; send_email() with + attachments (#1253) + + *) mathpreview: js-based math preview panel (#1221) + + *) oaiharvest: fixes harvest() web interface (#2524) + + *) plotextractor: recid parsing fix (#2566); sanity in plotextractor + tests; do not add FFT if there is no location; remove dummy + caption generation; fixes arg parsing and more; more shell + argument escaping; process files of a record; fix CLI parameters + parsing + + *) redisutils: initial release + + *) sequtils: increases size of seqSTORE.seq_value; no texkey if no + year; increases size of seqSTORE.seq_value; fix texkey generation; + add start_date parameter to CnumSeq; wait for BibUpload to finish; + new seq generator for texkeys + + *) shellutils: Mac OS compatibility (#1184) + + *) solrutils: clean unit and regression test suite (#1284); add + search and ranking tests; fix for ranking result display; better + collection filter generator; removal of unused code; better + invalid character handling (#1197); add documentation + + *) testutils: wait for element to be displayed/hidden; default to + assertEqual in py26; add new relative url function; + regression_tests fix; new JavaScript unit test framework + + *) textmarc2xmlmarc: remove content regexp check (#1267) + + *) textutils: wash_for_utf8() simplification (#1755); + translate_to_ascii() unknown chars fix (#1754); show_diff() API + clean-up (#1465); fix old import statement; sharp-s to ss; + unidecode verision; add ALA-LC transliteration (#1092); create + function to show diff view + + *) urlutils: new function get_relative_url(); use hashlib instead of + md5 if possible + + *) xmlmarc2textmarc: order only by tags + Invenio v1.1.5 -- released 2015-03-02 ------------------------------------- *) BibCirculation: get_book_cover quick fix (#2578 #2653); fix for wrong non-borrower message (#2597) *) OAIHarvest: remove_duplicates and regexp fixes (#2300 #2608) *) WebBasket: better formatting of deletion message (#2449) *) docker: initial release (#2736) *) docs: initial release of CONTRIBUTING guide (#2163) *) installation: MathJax distribution location update (#2732); explicit jQuery plugin versions (#11 #2655); disable SSLv2/SSLv3 in Apache config (#2515) Invenio v1.0.8 -- released 2015-03-02 ------------------------------------- *) docker: initial release (#2736) *) docs: initial release of CONTRIBUTING guide (#2163) *) installation: MathJax distribution location update (#2732); disable SSLv2/SSLv3 in Apache config (#2515) Invenio v1.1.4 -- released 2014-08-31 ------------------------------------- *) BibDocFile: FFT comment/description documentation (#635); duplicate docname fix (#1930); convert files and icons asynchronously (#1428) *) BibEncode: fix video-encoded files synchro to DB (#1647) *) BibRank: (Overflow|ZeroDivision)Error usability (#105 #2146) *) BibSched: authorization typo fix in BibTasklet (#1746); more customizable icon creation tasklet; icons creation tasklet *) BibSort: `last_updated` column name typo fix (#1408 #1742) *) OAIRepository: OAI-PMH handler URL documented (#1027 #2152) *) WebComment: attachments in multi-node setup *) WebJournal: update demo "Article Header" style *) WebSearch: disable meta tags for deleted records (#1680) *) WebSession: CSRF token in API key settings form (#1855); CSRF tokens in account settings forms (#1855); Python-2.4 combatibility issue fix *) WebSubmit: file stamper option to copy metadata (#1569); new Create_Modify_Interface parameters; value escaping for modifications (#1578); better value escaping (#1578); more customizable Link_Records function; no double-submit (#1020) *) installation: GnuPG key server location update; location of jquery.treeview *) jQuery: fix for DataTables dependency URL location (#2078) *) sequtils: more robust cnum generation (#2119) *) I18N: fix gender problem in a French translation (#2089) Invenio v1.0.7 -- released 2014-08-31 ------------------------------------- *) BibDocFile: FFT comment/description documentation (#635); duplicate docname fix (#1930) *) BibRank: (Overflow|ZeroDivision)Error usability (#105 #2146) *) WebSession: CSRF tokens in account settings forms (#1855) *) installation: GnuPG key server location update; location of jquery.treeview *) I18N: fix gender problem in a French translation (#2089) Invenio v1.1.3 -- released 2014-02-25 ------------------------------------- *) BatchUploader: rights to ::1 for robot upload; avoid tempfile.tempdir redefinition (#1594) *) BibCatalog: no newlines in subject for RT plugin *) BibDocFile: RHEL6 magic bindings support (#1466) *) BibFormat: fix for BibTeX regression tests; better BibTeX title and collaboration *) BibRank: temporary file storage in CFG_TMPDIR (#1594) *) BibSword: author MARC tag definition fix *) BibUpload: FFT replace warning in guide *) I18N: PO file update for the release of v1.1.3; PO file update for the release of v1.0.6; PO file update for the release of v0.99.9; collection demo names for new translations *) OAIHarvest: for for bad exception handling *) OAIRepository: optional support for --notimechange *) Travis CI: initial release of configuration *) WebSearch: nonexisting record API test case fix (#1692); correct record sums from hosted colls (#1651); space between records in MARC HTML; fix for BibTeX regression tests; field-filtered MARCXML API output (#1591); more complete API regression test suite; get_fieldvalues_alephseq_like() utils; asciification of `oe` grapheme (#1582); bug fix for SPIRES date math search *) WebSession: fix mail cookie expiration (#1596) *) WebSubmit: fix for typo in Shared_Functions; optional pdftk regression tests *) dbquery: closes redundant connection *) git: addition of compile to gitignore; new entry in gitignore *) global: language value always in link URLs *) installation: pip requirement version updates; pip requirements; no user prompt for warnings; empty Travis configuration; location of jquery-1.7.1.min.js; location of flot; information about unidecode; fix autotools rsync instructions *) intbitset: no crash when intbitset is on rhs (#1287) *) inveniocfg: fix for mod_headers *) kwalitee: list comprehensions instead of lambdas; compatibility with pylint 1.0.0 Invenio v1.0.6 -- released 2014-01-31 ------------------------------------- *) BatchUploader: avoid tempfile.tempdir redefinition (#1594) *) BibRank: temporary file storage in CFG_TMPDIR (#1594) *) BibUpload: FFT replace warning in guide *) dbquery: closes redundant connection *) global: language value always in link URLs *) installation: fix autotools rsync instructions; pip requirements; pip requirement version updates *) intbitset: no crash when intbitset is on rhs (#1287) *) WebSearch: asciification of `oe` grapheme (#1582); correct record sums from hosted colls (#1651); nonexisting record API test case fix (#1692); space between records in MARC HTML *) WebSession: fix mail cookie expiration (#1596) *) WebSubmit: fix for typo in Shared_Functions CDS Invenio v0.99.9 -- released 2014-01-31 ------------------------------------------ *) temporary file storage in CFG_TMPDIR (BibRank) Invenio v1.1.2 -- released 2013-08-19 ------------------------------------- *) BibAuthorID: fix in name comparisons (#1313 #1314); improvements and fixes; improvements, fixes and optimizations; UI and backend improvements *) BibCatalog: removal of print statement (#1337) *) BibClassify: escape keywords in tag cloud and MARCXML *) BibDocFile: better JS washing in web UI; display file upload progress (#1020 #1021); display "Restricted" label correctly (#1299); fix check-md5 with bibdocfsinfo cache (#1249); fix check-md5 with bibdocfsinfo cache (#1249); fix error in calling register_download (#1311); handling of exceptions in Md5Folder (#1060); revert md5 property patch (#1249); support new magic library (#1207) *) BibEncode: minor fix in process_batch_job() *) BibFormat: additional fulltext file display in HB (#1219); checks for bibformat bin; fix CLI call to old PHP-based formatter; fixes unit tests (#1320); fix for fulltext file format; fix snippets for phrase queries (#1201); format_element initialisation fix; passing of user_info for Excel format; replacement of CDS Invenio by Invenio; setUp/tearDown in unit tests (#1319); skip hidden icons in OpenGraph image tag *) BibIndex: better wording for stemming in admin UI; replacement of CDS Invenio by Invenio; synonym indexing speed up (#1484); use human friendly index name (#1329) *) BibKnowledge: /kb/export 500 error fix; optional memoisation of KBR lookups (#1484) *) BibMerge: delete cache file on submit *) BibSched: bibupload max_priority check; bugfix for high-priority monotasks; increases size of monitor columns; parse_runtime_limit() fix (#1432); parse_runtime_limit() tests fix (#1432) *) BibUpload: FMT regression test case fix (#1152); indicators in strong tags (#939) *) CKEditor: updated to version 3.6.6 *) dateutils: strftime improvement (#1065); strptime for Python-2.4 compatibility *) errorlib: hiding bibcatalog info in exception body *) global: test suite nosification *) htmlutils: fix single quote escaping; improve js string escaping; MathJax 2.1 (#1050) *) I18N: updates to Catalan and Spanish translations *) installation: fix collectiondetailedrecordpagetabs (#1496); fix for jQuery hotkeys add-on URL (#1507); fix for MathJax OS X install issue (#1455); support for Apache-2.4 (#1552) *) inveniocfg: tests runner file closure fix (#1327) *) InvenioConnector: fix for CDS authentication; mechanize dependency *) inveniogc: consider journal cache subdirs *) memoiseutils: initial release *) OAIHarvest: fix path for temporary authorlists; holding-pen UI bugfixes (#1401) *) OAIRepository: CFG_OAI_REPOSITORY_MARCXML_SIZE; no bibupload -n *) RefExtract: replacement of CDS Invenio by Invenio *) WebAccess: fix variable parsing in robot auth (#1456); IP-based rules and offline user fix (#1233); replacement of CDS Invenio by InveniO *) WebApiKey: renames unit tests to regression tests (#1324) *) WebAuthorProfile: fix XSS vulnerability *) WebComment: escape review "title"; escape review "title" *) WebSearch: 410 HTTP code for deleted records; advanced search notification if no hits; better cleaning of word patterns; fix infinite synonym lookup cases (#804); handles "find feb 12" (#948); nicer browsing of fuzzy indexes (#1348); respect default `rg` in Advanced Search; SPIRES date math search fixes (#431 #948); SPIRES invalid date search fix (#1467); tweaks SPIRES two-digit search; unit test disabling for CFG_CERN_SITE; unit test update (#1326) *) WebSession: fix for list of admin activities (#1444); login_method changes; unit vs regression test suite cleanup *) WebStat: use CFG_JOURNAL_TAG instead of 773/909C4 (#546) *) WebSubmit: new websubmitadmin CLI (#1334); replacement of CDS Invenio v1.0.5 -- released 2013-08-19 ------------------------------------- *) BibClassify: escape keywords in tag cloud and MARCXML *) BibDocFile: support new magic library *) BibFormat: additional fulltext file display in HB; fix CLI call to old PHP-based formatter; format_element initialisation fix *) BibIndex: better wording for stemming in admin UI *) BibKnowledge: /kb/export 500 error fix *) BibUpload: FMT regression test case fix; indicators in strong tags *) errorlib: hiding bibcatalog info in exception body *) global: test suite nosification *) installation: fix collectiondetailedrecordpagetabs; support for Apache-2.4 *) WebAccess: IP-based rules and offline user fix; replacement of CDS Invenio by InveniO *) WebComment: escape review "title" *) WebSearch: respect default `rg` in Advanced Search *) WebSession: fix for list of admin activities; login_method changes *) WebSubmit: new websubmitadmin CLI CDS Invenio v0.99.8 -- released 2013-08-19 ------------------------------------------ *) escape keywords in tag cloud and MARCXML (BibClassify) *) fix CLI call to old PHP-based formatter; fix format_element initialisation (BibFormat) *) better wording for stemming in admin UI (BibIndex) *) IP-based rules and offline user fix (WebAccess) *) escape review "title" (WebComment) *) fix collectiondetailedrecordpagetabs (installation) Invenio v1.1.1 -- released 2012-12-21 ------------------------------------- *) BatchUploader: error reporting improvements *) BibAuthorID: arXiv login upgrade; fix for small bug in claim interface *) BibConvert: fix bug with SPLITW function; target/source CLI flag description fix *) BibDocFile: better error report for unknown format; explicit redirection to secure URL; fix for file upload in submissions *) BibEdit: 'bibedit' CSS class addition to page body *) BibFormat: clean Default_HTML_meta template; fix for js_quicktags location; ISBN tag update for meta format; "ln" parameter in bfe_record_url output; meta header output fix; relator code filter in bfe_authors; fix for reformatting by record IDs *) errorlib: register_exception improvements *) global: login link using absolute URL redirection *) installation: aidUSERINPUTLOG consistency upgrade; bigger hstRECORD.marcxml size; fix for wrong name in tabcreate; inclusion of JS quicktags in tarball; mark upgrade recipes as applied; rephrase 1.1 upgrade recipe warning; safer upgrader bibsched status parse; strip spaces in CFG list values *) jQuery: tablesorter location standardisation *) mailutils: authentication and TLS support *) OAIRepository: Edit OAI Set page bug fix; fix for OAI set editing; print_record() fixes *) plotextractor: washing of captions and context *) pluginutils: fix for failing bibformat test case *) solrutils: addition of files into release tarball *) WebAccess: admin interface usability improvement; guest unit tests for firerole *) WebAlert: new regression tests for alerts *) WebComment: cleaner handling of non-reply comments *) WebJournal: better language handling in widgets; CERN-specific translation; explicit RSS icon dimensions; fix for CFG_TMPSHAREDDIR; fix for retrieval of deleted articles; search select form by name *) WebSearch: fix for webcoll grid layout markup; get_all_field_values() typo; next-hit/previous-hit numbering fix; respect output format content-type; washing of 'as' argument *) WebSession: fix for login-with-referer issue; fix for merge_usera_into_userb() *) WebStyle: dumb page loading fix Google Analytics documentation update; memory leak fix in session handling; new /ping handler; removal of excess language box call; req.is_https() fix; *) WebSubmit: display login link on /submit page; fix for Send_APP_Mail function; fix the approval URL for publiline *) WebUser: fix for referer URL protocol Invenio v1.0.4 -- released 2012-12-21 ------------------------------------- *) installation: inclusion of JS quicktags in tarball *) bibdocfile: better error report for unknown format *) WebAccess: admin interface usability improvement Invenio v1.0.3 -- released 2012-12-19 ------------------------------------- *) BatchUploader: error reporting improvements *) BibConvert: fix bug with SPLITW function; target/source CLI flag description fix *) BibEdit: 'bibedit' CSS class addition to page body *) BibFormat: fix for js_quicktags location *) jQuery: tablesorter location standardisation *) WebComment: cleaner handling of non-reply comments *) WebJournal: explicit RSS icon dimensions; fix for CFG_TMPSHAREDDIR; fix for retrieval of deleted articles *) WebSearch: external search pattern_list escape fix; respect output format content-type; washing of 'as' argument *) WebStyle: dumb page loading fix; Google Analytics documentation update; memory leak fix in session handling; new /ping handler; removal of excess language box call; req.is_https() fix *) WebSubmit: fix for Send_APP_Mail function *) WebUser: fix for referer URL protocol CDS Invenio v0.99.7 -- released 2012-12-18 ------------------------------------------ *) Google Analytics documentation update (WebStyle) *) target/source CLI flag description fix (BibConvert) Invenio v1.1.0 -- released 2012-10-21 ------------------------------------- *) BatchUploader: RESTful interface, runtime checks, TextMARC input, job priority selection *) BibAuthorID: new automatic author disambiguation and paper claiming facility *) BibCatalog: storage of ticket requestor, default RT user *) BibCirculation: security fixes *) BibClassify: UI improvements and refactoring *) BibConvert: new BibTeX-to-MARCXML conversion, new oaidmf2marcxml conversion, fixes for WORDS *) BibDocFile: new filesystem cache for faster statistics, caseless authorisation, disable HTTP range requests, improve file format policies, and more *) BibEdit: new options related to preview and printing, reference curation, autocompletion, record and field template manager, editing fields and subfields, per-collection authorisations, use of knowledge bases, and more *) BibEditMulti: new actions with conditions on fields, partial matching for subfields, faster preview generation, and more *) BibEncode: new audio and video media file processing tool, new Video demo collection *) BibFormat: new full-text snippet display facility, new configuration for I18N caching, updates to EndNote, Excel, Dublin Core and other formats, updates to formatting elements such as DOI, author, updates to podcast output, updates to XSLT processing, and more *) OAIHarvest: new configurable workflow with reference extraction, new author list extraction post process, upload priority, OpenAIRE compliance, better handling of timeouts, and more *) BibIndex: new full-text indexing via Solr, new support for author ID indexing, better author tokeniser *) BibKnowledge: dynamic knowledge bases for record editor, support for JSON format *) BibMatch: new matching of restricted collections *) BibMerge: subfield order in slave record, confirmation pop up, record selection bug fix *) BibRank: new index term count ranking method, new support for flot graphs, updates to citation graphs *) BibRecord: new possibility to use lxml parser, sanity checks *) BibSched: new motd-like facility for queue monitor, new continuable error status for tasks, new tasklet framework, new multi-node support, new monotask support, new support for task sequences, improvements to scheduling algorithm *) BibSort: new in-memory fast sorting tool using configurable buckets *) BibUpload: new automatic generation of MARC tag 005, new `--callback-url' CLI parameter, fixes for appending existing files, fixes for multiple 001 tags, and more *) WebAccess: new external person ID support, performance improvements, robot manager UI improvements, fixes for firerole handling, *) WebAlert: new alert description facility, fixes for restricted collections *) WebApiKey: new user-signed Web API key facility *) WebAuthorProfile: new author pages with dynamic box layout *) WebBasket: add to basket interface improvements, better XML export, fixes for external records and other improvements *) WebComment: new collapsible comment support, new permalink to comments, loss prevention of unsubmitted comments, tidying up HTML markup of comments, and more *) WebJournal: new Open Graph markup, more customisable newsletter, redirect to latest release of specific category, refresh chosen collections on release, remove unnecessary encoding/decoding, update weather widget for new APIs, and more *) WebSearch: new index-time and search-time synonym support, new Open Graph markup, new Google Scholar friendly metadata in page header, new limit option for wildcard queries, new support for access to merged records, new next/previous/back link support, new `authorcount' indexing and searching, new relative date search facility, clean OpenSearch support, improved speed, improvements to SPIRES query syntax support, improvements to self-cite math, primary collection guessing, other numerous fixes *) WebSession: new useful guest sessions, reintroduces configurable IP checking, enforcement of nickname refresh, several other fixes *) WebStat: new login statistics, new custom query summary, error analyser, custom event improvements *) WebStyle: new display restriction flag for restricted records, new initial right-to-left language support, authenticated user and HTTPS support, IP check for proxy configurations, layout updates and fixes for MSIE, and more *) WebSubmit: new initial support for converting to PDF/X, new embargo support, better LibreOffice compatibility, better async file upload, enhancements for Link_Records, support for hiding HIDDEN files in document manager, configurable initial value for counter, make use of BibSched task sequences, and more *) installation: updates to jQuery, CKEditor, unoconv, and other prerequisites *) dbdump: new compression support, reworked error handling *) dbquery: new possibility to query DB slave nodes, new dict-like output, fix for MySQL 5.5.3 and higher versions *) errorlib: stack analysis improvements, outline style improvements for invenio.err *) htmlutils: improvements to HTML markup removal, HTML tidying *) I18N: new Arabic and Lithuanian translations, updates to Catalan, Czech, French, German, Greek, Italian, Russian, Slovak, Spanish translations *) intbitset: new performance improvements, new get item support, new pickle support, several memory leak fixes *) inveniocfg: new automated Invenio Upgrader tool *) InvenioConnector: new search with retries, improved search parameters, improved local site check, use of Invenio user agent *) jsonutils: new JSON utility library *) mailutils: possibility to specify Reply-To header, fixes to multipart *) plotextractor: better TeX detection, better PDF harvesting from arXiv, configurable sleep timer *) pluginutils: new create_enhanced_plugin_builder API, external plugin loading *) RefExtract: new daemon operation mode, new DOI recognition, better author recognition, new author knowledge base *) remote debugger: new remote debuggng support *) sequtils: new sequence generator tool *) solrutils: new support for full-text query dispatching to Solr *) testutils: new Selenium web test framework *) textutils: updates to string-to-ascii functions, LaTeX symbols to Unicode *) urlutils: fix for redirect_to_url *) xmlmarclint: fix for error report formatting *) ... and other numerous smaller fixes and improvements Invenio v1.0.2 -- released 2012-10-19 ------------------------------------- *) BibConvert: fix for static files in admin guide *) BibEdit: regression test case fix *) BibFormat: fix call to bfe_primary_report_number; revert fix for format validation report *) BibHarvest: OAI harvesting via HTTP proxy *) BibRank: begin_date initialisation in del_recids(); INSERT DELAYED INTO rnkPAGEVIEWS; user-friendlier message for similar docs *) BibUpload: clarify correct/replace mode help *) WebJournal: catch ValueError when reading cache; use CFG_TMPSHAREDDIR in admin UI *) WebSearch: allow webcoll to query hidden tags; external collection search fix; external search XSS vulnerability fix; fix for parentheses inside quotes; get_collection_reclist() fix; more uses of `rg` configurable default; 'verbose' mode available to admins only; XSS and verbose improvements *) WebSession: fix possibly undefined variables; prevent nickname modification *) WebStyle: workaround IE bug with cache and HTTPS *) WebSubmit: configurable Document File Manager; fix JS check for mandatory fields; unoconv calling fix *) bibdocfile: guess_format_from_url() improvement; guess_format_from_url() improvements; INSERT DELAYED INTO rnkDOWNLOADS *) global: removal of psyco *) I18N: Spanish and Catalan updates to Search Tips; updates to German translation *) installation: fix for jQuery UI custom; fix md5sum example arguments; new index on session.session_expiry *) intbitset: fix memory leak *) inveniogc: tmp directory removal improvements *) urlutils: MS Office redirection workaround CDS Invenio v0.99.6 -- released 2012-10-18 ------------------------------------------ *) improved XSS safety in external collection searching (WebSearch) *) verbose level in the search results pages is now available only to admins, preventing potential restricted record ID disclosure even though record content would remain restricted (WebSearch) Invenio v1.0.1 -- released 2012-06-28 ------------------------------------- *) BibFormat: fix format validation report; fix opensearch prefix exclusion in RSS; fix retrieval of collection identifier *) BibIndex: new unit tests for the Greek stemmer *) BibSched: improve low level submission arg parsing; set ERROR status when wrong params; task can stop immediately when sleeping *) BibSword: remove dangling documentation *) BibUpload: fix setting restriction in -a/-ir modes *) WebAlert: simplify HTML markup *) WebComment: only logged users to use report abuse *) WebJournal: hide deleted records *) WebSearch: adapt test cases for citation summary; fix collection order on the search page; look at access control when webcolling; sorting in citesummary breakdown links *) WebSession: simplify HTML markup *) WebSubmit: capitalise doctypes in Doc File Manager; check authorizations in endaction; check for problems when archiving; ensure unique tmp file name for upload; fix email formatting; fix Move_to_Done function; remove 8564_ field from demo templates; skip file upload if necessary; update CERN-specific config *) bibdocfile: BibRecDocs recID argument type check *) data cacher: deletes cache before refilling it *) dbquery: fix dbexec CLI WRT max allowed packet *) I18N: updates to Greek translation *) installation: fix circular install-jquery-plugins; fix demo user initialisation; fix jQuery tablesorter download URL; fix jQuery uploadify download URL; more info about max_allowed_packet; remove unneeded rxp binary package Invenio v1.0.0 -- released 2012-02-29 ------------------------------------- *) BatchUploader: fix retrieval of recs from extoaiid *) BibCirculation: fix regexp for dictionary checking; security check before eval *) BibConvert: fix UP and DOWN for UTF-8 strings *) bibdocfile: add missing normalize_format() calls; check_bibdoc_authorization caseless; fix append WRT description/restriction; fix cli_set_batch function; fix documentation WRT --with-version; fix handling of embargo firerole rule; fix parsing of complex subformats *) BibEdit: fix crash in Ajax request; fix undefined dictionary key *) BibFormat: better escape BFE in admin test UI; do not exit if no XSLT processor found; fix regression test; fix URL to ejournal resolver; fix XSLT formatting of MARCXML snippets; removes 'No fulltext' message; special handling of INSPIRE-PUBLIC type; use default namespace in XSL *) BibHarvest: check for empty resumptionToken; fix MARCXML creation in OAI updater; optional JSON dependency *) BibIndex: fix author:Campbell-Wilson word query; fix double-stemming upon indexing; fix Porter stemmer in multithread; Greek stemmer improvements *) BibKnowledge: make XML/XSLT libs optional *) BibRank: CERN hack to inactivate similarity lists; fix citation indexer time stamp updating; fix citation indexing of deleted records; fix citedby/refersto for infinite sets; fix empty citation data cacher; fix incremental citation indexer leaks; make numpy optional; minimum x-axis in citation history graphs; run citation indexer after word indexer *) BibRecord: fix for record_get_field_instances() *) BibSched: fix guess_apache_process_user_from_ps; use larger timouts for launching tasks *) BibUpload: FFT regression tests not to use CDS *) htmlutils: fix FCKeditor upload URLs *) installation: add note about optional hashlib; change table TYPE to ENGINE in SQL; fix 'install-mathjax-plugin'; fix issue with FCKeditor; fix 'make install-jquery-plugins'; fix output message cosmetics; new 'make install-ckeditor-plugin'; re-enable WSGI pre-loading *) intbitset: fix never ending loop in __repr__; fix several memory leaks *) inveniocfg: fix resetting ranking method names *) inveniogc: new CLI options check/optimise tables *) kwalitee: grep-like output and exit status changes; use `--check-some` as default CLI option *) mailutils: remove unnecessary 'multipart/related' *) plotextractor: fix INSPIRE unit test *) textmarc2xmlmarc: fix handling of BOM *) urlutils: new Indico request generator helper *) WebAccess: fix Access policy page; fix FireRole handling integer uid; fix retrieving emails from firerole *) WebAlert: fix the display of records in alerts *) WebBasket: fix missing return statement; fix number of items in public baskets *) WebComment: CERN-specific hack for ATLAS comments; fix discussion display in bfe_comments; fix washing of email to admin; improve sanity checks *) WebHelp: HOWTO MARC document update *) WebJournal: fix seminar widget encoding issue; fix seminar widget for new Indico APIs; update weather widget for new APIs *) WebSearch: add refersto:/a b c/ example to guide; CERN-specific hack for journal sorting; CERN-specific hack for latest additions; fix case-insensitive collection search; fix CDSIndico external search; fix collection translation in admin UI; fix get_fieldvalues() when recid is str; fix get_index_id_from_field(); fix structured regexp query parsing; fix symbol name typo in loop checking; parenthesised collection definitions; remove accent-search warning in guide; remove Report for INSPIRE author pages; replace CDS Indico by Indico; updates some output phrases *) WebSession: fix crash when no admin user exists *) WebStyle: better service failure message; fix implementation of req.get_hostname; fluid width of the menu; pre-load citation dictionaries for web *) WebSubmit: avoid printing empty doctype section; check_user_can_view_record in publiline; fix filename bug in document manager; fix handling of uploaded files; fix record_search_pattern in DEMOJRN *) xmlmarclint: 'no valid record detected' error *) I18N: updates to Catalan, Czech, French, German, Greek, Italian, Slovak, and Spanish translations *) Note: for a complete list of new features in Invenio v1.0 release series over Invenio v0.99 release series, please see: CDS Invenio v0.99.5 -- released 2012-02-21 ------------------------------------------ *) improved sanity checks when reporting, voting, or replying to a comment, or when accessing comment attachments, preventing URL mangling attempts (WebComment) CDS Invenio v0.99.4 -- released 2011-12-19 ------------------------------------------ *) fixed double stemming during indexing (BibIndex) *) fixed collection translation in admin UI (WebSearch) *) fixed UP and DOWN functions for UTF-8 strings (BibConvert) Invenio v1.0.0-rc0 -- released 2010-12-21 ----------------------------------------- *) CDS Invenio becomes Invenio as of this release *) new facility of hosted collections; support for external records in search collections, user alerts and baskets (WebSearch, WebAlert, WebBasket) *) support for nested parentheses in search query syntax (WebSearch) *) new refersto/citedby search operators for second-order searches in citation map (BibRank, WebSearch) *) numerous improvements to SPIRES query syntax parser (WebSearch) *) enhancement to search results summaries, e.g. co-author lists on author pages, e.g. h-index (WebSearch) *) new support for unAPI, Zotero, OpenSearch, AWS (WebSearch) *) new phrase and word-pair indexes (BibIndex) *) new fuzzy author name matching mode (BibIndex) *) new time-dependent citation ranking family of methods (BibRank) *) full-text search now shows context snippets (BibFormat) *) improvements to the basket UI, basket export facility (WebBasket) *) new support for FCKeditor in submissions and user comments, possibility to attach files (WebComment, WebSubmit) *) commenting facility enhanced with rounds and threads (WebComment) *) new facility to moderate user comments (WebComment) *) enhanced CLI tool for document file management bringing new options such as hidden file flag (WebSubmit) *) numerous improvements to the submission system, e.g. asynchronous JavaScript upload support, derived document formats, icon creation, support for automatic conversion of OpenOffice documents, PDF/A, OCR (WebSubmit) *) new full-text file metadata reader/writer tool (WebSubmit) *) new experimental SWORD protocol client application (BibSword) *) complete rewrite of the record editor using Ajax technology for faster user operation, with new features such as field templates, cloning, copy/paste, undo/redo, auto-completion, etc (BibEdit) *) new multi-record editor to alter many records in one go (BibEdit) *) new Ajax-based record differ and merger (BibMerge) *) new fuzzy record matching mode, with possibility to match records against remote Invenio installations (BibMatch) *) new circulation and holdings module (BibCirculation) *) new facility for matching provenance information when uploading records (BibUpload) *) new possibility of uploading incoming changes into holding pen (BibUpload) *) new batch uploader facility to support uploading of metadata files and of full-text files either in CLI or over web (BibUpload) *) new record exporting module supporting e.g. Sitemap and Google Scholar export methods (BibExport) *) improvements to the keyword classifier, e.g. author and core keywords (BibClassify) *) new facility for external robot-like login method (WebAccess) *) numerous improvements to the journal creation facility, new journal `Atlantis Times' demo journal (WebJournal) *) refactored and improved OAI exporter and harvester (BibHarvest) *) new taxonomy-based and dynamic-query knowledge base types (BibKnowledge) *) possibility to switch on/off user features such as alerts and baskets based on RBAC rules (WebAccess and other modules) *) various improvements to task scheduler, for example better communication with tasks, possibility to run certain bibsched tasks within given time limit, etc (BibSched) *) new database dumper for backup purposes (MiscUtil) *) new plotextractor library for extracting plots from compuscripts, new figure caption index and the Plots tab (MiscUtil, BibIndex, Webearch) *) enhanced reference extrator, e.g. support for DOI, for author name recognition (MiscUtil) *) new register emergency feature e.g. to alert admins by SMS in case the task queue stops (MiscUtil) *) infrastructure move from mod_python to mod_wsgi, support for mod_xsendfile (WebStyle and many modules) *) infrastructure move from jsMath to MathJax (MiscUtil) *) some notable backward-incompatible changes: removed authentication methods related to Apache user and group files, changed BibFormat element's API (BibFormat, many modules) *) new translations (Afrikaans, Galician, Georgian, Romanian, Kinyarwanda) plus many translation updates *) other numerous improvements and bug fixes done in about 1600 commits over Invenio v0.99 series CDS Invenio v0.99.3 -- released 2010-12-13 ------------------------------------------ *) fixed issues in the harvesting daemon when harvesting from more than one OAI repository (BibHarvest) *) fixed failure in formatting engine when dealing with not-yet-existing records (BibFormat) *) fixed traversal of final URL parts in the URL dispatcher (WebStyle) *) improved bibdocfile URL recognition upon upload of MARC files (BibUpload) *) fixed bug in admin interface for adding authorizations (WebAccess) *) keyword extractor is now compatible with rdflib releases older than 2.3.2 (BibClassify) *) output of `bibsched status' now shows the queue mode status as AUTOMATIC or MANUAL to help queue monitoring (BibSched) CDS Invenio v0.99.2 -- released 2010-10-20 ------------------------------------------ *) stricter checking of access to restricted records: in order to view a restricted record, users are now required to have authorizations to access all restricted collections the given record may belong to (WebSearch) *) strict checking of user query history when setting up email notification alert, preventing URL mangling attempts (WebAlert) *) fixed possible Unix signal conflicts for tasks performing I/O operations or running external processes, relevant notably to full-text indexing of remote files (BibSched) *) fixed full-text indexing and improved handling of files of `unexpected' extensions (BibIndex, WebSubmit) *) streaming of files of `unknown' MIME type now defaults to application/octet-stream (WebSubmit) *) fixed addition of new MARC fields in the record editor (BibEdit) *) fixed issues in full-text file attachment via MARC (BibUpload) *) fixed authaction CLI client (WebAccess) *) ... plus other minor fixes and improvements CDS Invenio v0.99.1 -- released 2008-07-10 ------------------------------------------ *) search engine syntax now supports parentheses (WebSearch) *) search engine syntax now supports SPIRES query language (WebSearch) *) strict respect for per-collection sort options on the search results pages (WebSearch) *) improved parsing of search query with respect to non-existing field terms (WebSearch) *) fixed "any collection" switch on the search results page (WebSearch) *) added possibility for progressive display of detailed record page tabs (WebSearch) *) added support for multi-page RSS output (WebSearch) *) new search engine summarizer module with the cite summary output format (WebSearch, BibRank) *) "cited by" links are now generated only when needed (WebSearch) *) new experimental comprehensive author page (WebSearch) *) stemming for many indexes is now enabled by default (BibIndex) *) new intelligent journal index (BibIndex) *) new logging of missing citations (BibRank) *) citation indexer and searcher improvements and caching (BibRank) *) new low-level task submission facility (BibSched) *) new options in bibsched task monitor: view task options, log and error files; prune task to a history table; extended status reporting; failed tasks now need acknowledgement in order to restart the queue (BibSched) *) safer handling of task sleeping and waking up (BibSched) *) new experimental support for task priorities and concurrent task execution (BibSched) *) improved user-configured browser language matching (MiscUtil) *) new default behaviour not differentiating between guest users; this removes a need to keep sessions/uids for guests and robots (WebSession) *) optimized sessions and collecting external user information (WebSession) *) improved logging conflicts for external vs internal users (WebAccess) *) improved Single Sign-On session preservation (WebAccess) *) new 'become user' debugging facility for admins (WebAccess) *) new bibdocfile CLI tool to manipulate full-text files archive (WebSubmit) *) optimized redirection of old URLs (WebSubmit) *) new icon creation tool in the submission input chain (WebSubmit) *) improved full-text file migration tool (WebSubmit) *) improved stamping of full-text files (WebSubmit) *) new approval-related end-submission functions (WebSubmit) *) comments and descriptions of full-text files are now kept also in bibdoc tables, not only in MARC; they are synchronized during bibupload (WebSubmit, BibUpload) *) fixed navigation in public baskets (WebBasket) *) added detailed record page link to basket records (WebBasket) *) new removal of HTML markup in alert notification emails (WebAlert) *) improved OAI harvester logging and handling (BibHarvest) *) improved error checking (BibConvert) *) improvements to the record editing tool: subfield order change, repetitive subfields; improved record locking features; configurable per-collection curators (BibEdit) *) fully refactored WebJournal module (WebJournal) *) new RefWorks output format, thanks to Theodoros Theodoropoulos (BibFormat) *) fixed keyword detection tool's output; deactivated taxonomy compilation (BibClassify) *) new /stats URL for administrators (WebStat) *) better filtering of unused translations (WebStyle) *) updated French, Italian, Norwegian and Swedish translations; updated Japanese translation (thanks to Makiko Matsumoto and Takao Ishigaki); updated Greek translation (thanks to Theodoros Theodoropoulos); new Hungarian translation (thanks to Eva Papp) *) ... plus many other minor bug fixes and improvements CDS Invenio v0.99.0 -- released 2008-03-27 ------------------------------------------ *) new Invenio configuration language, new inveniocfg configuration tool permitting more runtime changes and enabling separate local customizations (MiscUtil) *) phased out WML dependency everywhere (all modules) *) new common RSS cache implementation (WebSearch) *) improved access control to the detailed record pages (WebSearch) *) when searching non-existing collections, do not revert to searching in public Home anymore (WebSearch) *) strict calculation of number of hits per multiple collections (WebSearch) *) propagate properly language environment in browse pages, thanks to Ferran Jorba (WebSearch) *) search results sorting made accentless, thanks to Ferran Jorba (WebSearch) *) new OpenURL interface (WebSearch) *) added new search engine API argument to limit searches to record creation/modification dates and times instead of hitherto creation dates only (WebSearch) *) do not allow HTTP POST method for searches to prevent hidden mining (WebSearch) *) added alert and RSS teaser for search engine queries (WebSearch) *) new optimized index structure for fast integer bit vector operations, leading to significant indexing time improvements (MiscUtil, BibIndex, WebSearch) *) new tab-based organisation of detailed record pages, with new URL schema (/record/1/usage) and related CSS changes (BibFormat, MiscUtil, WebComment, WebSearch, WebStyle, WebSubmit) *) phased out old PHP based code; migration to Python-based output formats recommended (BibFormat, WebSubmit) *) new configurability to show/hide specific output formats for specific collections (BibFormat, WebSearch) *) new configurability to have specific stemming settings for specific indexes (BibIndex, WebSearch) *) optional removal of LaTeX markup for indexer (BibIndex, WebSearch) *) performance optimization for webcoll and optional arguments to refresh only parts of collection cache (WebSearch) *) optional verbosity argument propagation to the output formatter (BibFormat, WebSearch) *) new convenient reindex option to the indexer (BibIndex) *) fixed problem with indexing of some lengthy UTF-8 accented names, thanks to Theodoros Theodoropoulos for reporting the problem (BibIndex) *) fixed full-text indexing of HTML pages (BibIndex) *) new Stemmer module dependency, fixes issues on 64-bit systems (BibIndex) *) fixed download history graph display (BibRank) *) improved citation ranking and history graphs, introduced self-citation distinction, added new demo records (BibRank) *) fixed range redefinition and output message printing problems in the ranking indexer, thanks to Mike Marino (BibRank) *) new XSLT output formatter support; phased out old BFX formats (BibFormat) *) I18N output messages are now translated in the output formatter templates (BibFormat) *) formats fixed to allow multiple author affiliations (BibFormat) *) improved speed of the record output reformatter in case of large sets (BibFormat) *) support for displaying LaTeX formulas via JavaScript (BibFormat) *) new and improved output formatter elements (BibFormat) *) new escaping modes for format elements (BibFormat) *) output format template editor cache and element dependency checker improvements (BibFormat) *) output formatter speed improvements in PHP-compatible mode (BibFormat) *) new demo submission configuration and approval workflow examples (WebSubmit) *) new submission full-text file stamper utility (WebSubmit) *) new submission icon-creation utility (WebSubmit) *) separated submission engine and database layer (WebSubmit) *) submission functions can now access user information (WebSubmit) *) implemented support for restricted icons (WebSubmit, WebAccess) *) new full-text file URL and cleaner storage facility; requires file names to be unique within a given record (WebSearch, WebSubmit) *) experimental release of the complex approval and refereeing workflow (WebSubmit) *) new end-submission functions to move files to storage space (WebSubmit) *) added support for MD5 checking of full-text files (WebSubmit) *) improved behaviour of the submission system with respect to the browser "back" button (WebSubmit) *) removed support for submission "cookies" (WebSubmit) *) flexible report number generation during submission (WebSubmit) *) added support for optional filtering step in the OAI harvesting chain (BibHarvest) *) new text-oriented converter functions IFDEFP, JOINMULTILINES (BibConvert) *) selective harvesting improvements, sets, non-standard responses, safer resumption token handling (BibHarvest) *) OAI archive configuration improvements: collections retrieval, multiple set definitions, new clean mode, timezones, and more (BibHarvest) *) OAI gateway improvements: XSLT used to produce configurable output (BibHarvest) *) added support for "strong tags" that can resist metadata replace mode (BibUpload) *) added external OAI ID tag support to the uploader (BibUpload) *) added support for full-text file transfer during uploading (BibUpload) *) preserving full history of all MARCXML versions of a record (BibEdit, BibUpload) *) XMLMARC to TextMarc improvements: empty indicators and more (BibEdit) *) numerous reference extraction tool improvements: year handling, LaTeX handling, URLs, journal titles, output methods, and more (BibEdit) *) new classification daemon (BibClassify) *) classification taxonomy caching resulting in speed optimization (BibClassify) *) new possibility to define more than one keyword taxonomy per collection (BibClassify) *) fixed non-standalone keyword detection, thanks to Annette Holtkamp (BibClassify) *) new embedded page generation profiler (WebStyle) *) new /help pages layout and webdoc formatting tool (WebStyle) *) new custom style template verification tool (WebStyle) *) added support for the XML page() output format, suitable for AJAX interfaces (WebStyle) *) introduction of navigation menus (WebStyle) *) general move from HTML to XHTML markup (all modules) *) fixed alert deletion tool vulnerability (WebAlert) *) do not advertise baskets/alerts much for guest users; show only the login link (WebSession) *) password reset interface improvements (WebSession) *) new permanent "remember login" mechanism (WebSession, WebAccess) *) local user passwords are now encrypted (WebSession, WebAccess) *) new LDAP external authentication plugin (WebAccess) *) new password reset mechanism using new secure mail cookies and temporary role membership facilities (WebAccess, WebSession) *) added support for Single Sign-On Shibboleth based authentication method (WebAccess) *) new firewall-like based role definition language, new demo examples (WebAccess) *) external authentication and groups improvements: nicknames, account switching, and more (WebSession, WebAccess) *) task log viewer integrated in the task monitor (BibSched) *) new journal creation module (WebJournal) *) new generic statistic gathering and display facility (WebStat) *) deployed new common email sending facility (MiscUtil, WebAlert, WebComment, WebSession, WebSubmit) *) dropped support for MySQL-4.0, permitting to use clean and strict UTF-8 storage methods; upgrade of MySQLdb to at least 1.2.1_p2 required (MiscUtil) *) uncatched exceptions are now being sent by email to the administrator (MiscUtil, WebStyle) *) new general garbage collector with a possibility to run via the task scheduler and a possibility to clean unreferenced bibliographic values (MiscUtil) *) new generic SQL and data cacher (MiscUtil) *) new HTML page validator plugin (MiscUtil) *) new web test suite running in a real browser (MiscUtil) *) improved code kwalitee checker (MiscUtil) *) translation updates: Spanish and Catalan (thanks to Ferran Jorba), Japanese (Toru Tsuboyama), German (Benedikt Koeppel), Polish (Zbigniew Szklarz and Zbigniew Leonowicz), Greek (Theodoros Theodoropoulos), Russian (Yana Osborne), Swedish, Italian, French *) new translations: Chinese traditional and Chinese simplified (thanks to Kam-ming Ku) *) ... plus many other minor bug fixes and improvements CDS Invenio v0.92.1 -- released 2007-02-20 ------------------------------------------ *) new support for external authentication systems (WebSession, WebAccess) *) new support for external user groups (WebSession) *) new experimental version of the reference extraction program (BibEdit) *) new optional Greek stopwords list, thanks to Theodoropoulos Theodoros (BibIndex) *) new Get_Recid submission function (WebSubmit) *) new config variable governing the display of the download history graph (BibRank) *) started deployment of user preferences (WebSession, WebSearch) *) split presentation style for "Narrow search", "Focus on" and "Search also" search interface boxes (WebSearch, WebStyle) *) updated CERN Indico and KEK external collection searching facility (WebSearch) *) fixed search interface portalbox and collection definition escaping behaviour (WebSearch Admin) *) fixed problems with external system number and OAI ID matching (BibUpload) *) fixed problem with case matching behaviour (BibUpload) *) fixed problems with basket record display and basket topic change (WebBasket) *) fixed output format template attribution behaviour (BibFormat) *) improved language context propagation in output formats (BibFormat) *) improved output format treatment of HTML-aware fields (BibFormat) *) improved BibFormat migration kit (BibFormat) *) improved speed and eliminated set duplication of the OAI repository gateway (BibHarvest) *) fixed resumption token handling (BibHarvest) *) improved record editing interface (BibEdit) *) fixed problem with empty fields treatment (BibConvert) *) updated Report_Number_Generation submission function to be able to easily generate report numbers from any submission information (WebSubmit) *) fixed problem with submission field value escaping (WebSubmit) *) fixed problem with submission collection ordering (WebSubmit) *) fixed BibSched task signal handling inconsistency (BibSched) *) fixed TEXT versus BLOB database problems for some tables/columns *) minor updates to the HOWTO Migrate guide and several admin guides (WebHelp, BibIndex, BibFormat) *) minor bugfixes to several modules; see ChangeLog for details and credits CDS Invenio v0.92.0 -- released 2006-12-22 ------------------------------------------ *) previously experimental output formatter in Python improved and made default (BibFormat) *) previously experimental new submission admin interface in Python improved and made default (WebSubmit) *) new XML-oriented output formatting mode (BibFormat) *) new export-oriented output formats: EndNote, NLM (BibFormat) *) RSS 2.0 latest additions feed service (WebSearch, BibFormat) *) new XML-oriented metadata converter mode (BibConvert) *) new metadata uploader in Python (BibUpload) *) new integrated parallel external collection searching (WebSearch) *) improved document classifier: composite keywords, wildcards, cloud output (BibClassify) *) improved UTF-8 fulltext indexing (BibIndex) *) improved external login authentication subsystem (WebAccess) *) added possibility to order submission categories (WebSubmit) *) improved handling of cached search interface page formats, preferential sort pattern functionality, international collection names (WebSearch) *) improved behaviour of OAI harvester: sets, deleted records, harvested metadata transformation (BibHarvest) *) improved MARCXML schema compatibility concerning indicators; updates to the HTML MARC output format (BibEdit, BibUpload, BibFormat, and other modules) *) multiple minor bugs fixed thanks to the wider deployment of the regression test suite (all modules) *) new translation (Croatian) and several translation updates (Catalan, Bulgarian, French, Greek, Spanish); thanks to Ferran Jorba, Beatriu Piera, Alen Vodopijevec, Jasna Marković, Theodoros Theodoropoulos, and Nikolay Dyankov (see also THANKS file) *) removed dependency on PHP; not needed anymore *) full compatibility with MySQL 4.1 and 5.0; upgrade from MySQL 4.0 now recommended *) full compatibility with FreeBSD and Mac OS X CDS Invenio v0.90.1 -- released 2006-07-23 ------------------------------------------ *) output messages improved and enhanced to become more easily translatable in various languages (all modules) *) new translation (Bulgarian) and several updated translations (Greek, French, Russian, Slovak) *) respect langugage choice in various web application links (WebAlert, WebBasket, WebComment, WebSession, WebSubmit) *) fixed problem with commenting rights in a group-shared basket that is also a public basket with lesser rights (WebBasket) *) guest users are now forbidden to share baskets (WebBasket) *) fixed guest user garbage collection, adapted to the new baskets schema (WebSession) *) added possibility to reject group membership requests; sending informational messages when users are approved/refused by group administrators (WebSession) *) experimental release of the new BibFormat in Python (BibFormat) *) started massive deployment of the regression test suite, checking availability of all web interface pages (BibEdit, BibFormat, BibHarvest, BibIndex, BibRank, MiscUtil, WebAccess, WebBasket, WebComment, WebMessage, WebSearch, WebSession, WebSubmit) *) updated developer documentation (I18N output messages policy, test suite policy, coding style) CDS Invenio v0.90.0 -- released 2006-06-30 ------------------------------------------ *) formerly known as CDSware; the application name change clarifies the relationship with respect to the CDS Sofware Consortium producing two flagship applications (CDS Indico and Invenio) *) version number increased to v0.90 in the anticipation of the forthcoming v1.0 release after all the major codebase changes are now over *) new possibility to define user groups (WebGroup) *) new personal basket organization in topics (WebBasket) *) new basket sharing among user groups (WebBasket) *) new open peer reviewing and commenting on documents (WebComment) *) new user and group web messaging system (WebMessage) *) new ontology-based document classification system (BibClassify) *) new WebSubmit Admin (WebSubmit) *) new record editing web interface (BibEdit) *) new record matching tool (BibMatch) *) new OAI repository administration tool (BibHarvest) *) new OAI periodical harvesting tool (BibHarvest) *) new web layout templating system (WebStyle) *) new clean URL schema (e.g. /collection/Theses, /record/1234) (WebStyle) *) new BibTeX output format support (BibFormat) *) new possibility of secure HTTPS authentication while keeping the rest of the site non-HTTPS (WebSession) *) new centralized error library (MiscUtil) *) new gettext-based international translations, with two new beta translations (Japanese, Polish) *) new regression testing suite framework (MiscUtil) *) new all prerequisites are now apt-gettable for Debian "Sarge" GNU/Linux *) new full support for Mac OS X *) ... plus many fixes and changes worth one year of development CDSware v0.7.1 -- released 2005-05-04 ------------------------------------- *) important bugfix for bibconvert's ``source data in a directory'' mode, as invoked by the web submission system (BibConvert) *) minor bugfix in the search engine, thanks to Frederic Gobry (WebSearch) *) minor bugfix in the WebSearch Admin interface (WebSearch) *) automatic linking to Google Print in the ``Haven't found what you were looking for...'' page box (WebSearch) *) BibFormat Admin Guide cleaned, thanks to Ferran Jorba *) new Catalan translation, thanks to Ferran Jorba *) updated Greek and Portuguese translations, thanks to Theodoros Theodoropoulos and Flávio C. Coelho *) updated Spanish translation CDSware v0.7.0 -- released 2005-04-06 ------------------------------------- *) experimental release of the refextract program for automatic reference extraction from PDF fulltext files (BibEdit) *) experimental release of the citation and download ranking tools (BibRank) *) new module for gathering usage statistics out of Apache log files (WebStat) *) new similar-records-navigation tool exploring end-user viewing habits: "people who viewed this page also viewed" (WebSearch, BibRank) *) OAI gateway validated against OAI Repository Explorer (BibHarvest) *) fixed "records modified since" option for the indexer (BibIndex) *) collection cache update is done only when the cache is not up to date (WebSearch) [closing #WebSearch-016] *) cleanup of user login mechanism (WebSession, WebAccess) *) fixed uploading of already-existing records in the insertion mode (BibUpload) *) fixed submission in UTF-8 languages (WebSubmit) *) updated HOWTO Run Your Existing CDSware Installation (WebHelp) *) test suite improvements (WebSearch, BibHarvest, BibRank, BibConvert) *) German translation updated and new German stopwords list added, thanks to Guido Pelzer *) new Greek and Ukrainian translations, thanks to Theodoros Theodoropoulos and Vasyl Ostrovskyi *) all language codes now comply to RFC 1766 and ISO 639 *) numerous other small fixes and improvements, with many contributions by the EPFL team headed by Frederic Gobry (BibConvert, BibUpload, WebSearch, WebSubmit, WebSession) CDSware v0.5.0 -- released 2004-12-17 ------------------------------------- *) new rank engine, featuring word similarity rank method and the journal impact factor rank demo (BibRank) *) search engine includes ranking option (WebSearch) *) record similarity search based on word frequency (WebSearch, BibRank) *) stopwords possibility when ranking and indexing (BibRank, BibIndex) *) stemming possibility when ranking and indexing (BibRank, BibIndex) *) search engine boolean query processing stages improved (WebSearch) *) search engine accent matching in phrase searches (WebSearch) *) regular expression searching mode introduced into the Simple Search interface too (WebSearch) *) Search Tips split into a brief Search Tips page and detailed Search Guide page (WebSearch) *) improvements to the ``Try your search on'' hints (WebSearch) *) author search hints introduced (WebSearch) *) search interface respects title prologue/epilogue portalboxes (WebSearch) *) improvements to admin interfaces (WebSearch, BibIndex, BibRank, WebAccess) *) basket item ordering problem fixed (WebBasket) *) access error messages introduced (WebAccess and its clients) *) new account management to enable/disable guest users and automatic vs to-be-approved account registration (WebAccess) *) possibility for temporary read-only access to, and closure of, the site; useful for backups (WebAccess and its clients) *) possibility for external authentication login methods (WebAccess) *) new XML MARC handling library (BibEdit) *) when uploading, bad XML records are marked as errors (BibUpload) *) improvements to the submission engine and its admin interface, thanks to Tiberiu Dondera (WebSubmit) *) preparations for electronic mail submission feature, not yet functional (ElmSubmit) *) added example on MARC usage at CERN (WebHelp) *) legacy compatibility with MySQL 3.23.x assured (BibUpload) *) legacy compatibility with Python 2.2 assured (WebSubmit) *) test suite additions and corrections (BibRank, BibIndex, WebSearch, BibEdit) *) French translation fixes, thanks to Eric Grand *) minor Czech and Slovak translation cleanup CDSware v0.3.3 (DEVELOPMENT) -- released 2004-07-16 --------------------------------------------------- *) new international phrases, collection and field names; thanks to Guido, Flavio, Tullio *) collection international names are now respected by the search engine and interfaces (WebSearch) *) field international names are now respected by the search engine and interfaces (WebSearch) *) when no hits found in a given collection, do not display all public hits straight away but only link to them (WebSearch) *) records marked as DELETED aren't shown anymore in XML MARC and other formats (WebSearch) *) detailed record page now features record creation and modification times (WebSearch) *) improved XML MARC parsing and cumulative record count in case of uploading of several files in one go (BibUpload) *) personal `your admin activities' page introduced (WebSession) *) added option to fulltext-index local files only (BibIndex) *) initial release of the BibIndex Admin interface (BibIndex) *) checking of mandatory selection box definitions (WebSubmit) *) WebSearch Admin interface cleanup (WebSearch) *) introducing common test suite infrastructure (WebSearch, BibIndex, MiscUtil, WebHelp) *) fixed accent and link problems for photo demo records (MiscUtil) *) conference title exported via OAI XML DC (BibHarvest) *) enabled building out of source directory; thanks to Frederic CDSware v0.3.2 (DEVELOPMENT) -- released 2004-05-12 --------------------------------------------------- *) admin area improved: all the modules have now Admin Guides; some guides were updated, some are still to be updated (WebHelp, BibConvert, BibFormat, BibIndex, BibSched, WebAlert, WebSession, WebSubmit, BibEdit, BibHarvest, BibRank, BibUpload, WebAccess, WebBasket, WebSearch, WebStyle) *) initial release of the WebSearch Admin interface (WebSearch) *) initial release of the BibRank Admin interface (BibRank) *) search cache expiry after insertion of new records (WebSearch) *) search engine now does on-the-fly formatting via BibFormat CLI call to handle restricted site situations (WebSearch) *) webcoll default verbosity decreased for efficiency (WebSearch) *) added BibConvert configuration example for converting XML Dublin Core to XML MARC (BibConvert) *) BibConvert knowledge base mode extended by various case-sensitive matching possibilities (BibConvert) *) fixed various problems with fulltext file names and the submission from MS Windows platform (WebSubmit) *) fixed problem with bibupload append mode not updating XML MARC properly (BibUpload) *) fixed small problems with the submission interface such as multiple fields selection (WebSubmit) *) session revoking and session expiry strengthened (WebSession) *) page design and style sheet updated to better fit large variety of browsers (WebStyle) *) added output format argument for basket display (WebBasket) *) new Swedish translation and updated German, Russian, and Spanish translations; thanks to Urban, Guido, Lyuba, and Magaly *) faster creation of I18N static HTML and PHP files during make CDSware v0.3.1 (DEVELOPMENT) -- released 2004-03-12 --------------------------------------------------- *) security fix preventing exposure of local configuration variables by malicious URL crafting (WebSearch, WebSubmit, WebAlert, WebBasket, WebSession, BibHarvest, MiscUtil) *) initial release of the ranking engine (BibRank) *) new guide on HOWTO Run Your CDSware Installation (WebHelp) *) fixed submit configurations with respect to fulltext links and metadata tags (WebSubmit, MiscUtil) *) Your Account personal corner now shows the list and the status of submissions and approvals (WebSession) *) uniform help and version number option for CLI executables (WebSearch, BibSched, BibIndex, BibRank, BibHarvest, BibConvert, WebAccess, BibFormat, WebSession, WebAlert) *) uniform technique for on-the-fly formatting of search results via `hb_' and `hd_' output format parameters (WebSearch) *) check for presence of pcntl and mysql PHP libraries (BibUpload) CDSware v0.3.0 (DEVELOPMENT) -- released 2004-03-05 --------------------------------------------------- *) new development branch release (important SQL table changes) *) introducing a new submission engine and the end-user web interface (WebSubmit) *) bibupload is now a BibSched task with new options (BibUpload) *) BibWords renamed into BibIndex in the view of future phrase indexing changes (BibIndex) *) more secure DB server connectivity (BibSched) *) record matching functionality (BibConvert) *) character encoding conversion tables (BibConvert) *) Qualified Dublin Core conversion example (BibConvert) *) OAI deleted records policy can now be specified (BibHarvest) *) multi-language collection portalboxes (WebSearch) *) HTML pages now respect language selections (WebSearch, WebHelp) *) minor layout changes (WebStyle) *) updated Russian and other translations *) ChangeLog is now generated from CVS log messages *) plus the usual set of bugfixes (see ChangeLog) CDSware v0.1.2 (DEVELOPMENT) -- released 2003-12-21 --------------------------------------------------- *) development branch release *) fix BibReformat task launching problem (BibFormat) *) fix BibTeX -> XML MARC conversion example (BibConvert) *) updated Spanish translation CDSware v0.1.1 (DEVELOPMENT) -- released 2003-12-19 --------------------------------------------------- *) development branch release *) access control engine now used by BibWords, BibFormat (admin and bibreformat), WebSearch (webcoll), and BibTaskEx *) access control engine admin guide started (WebAccess) *) search engine support for sorting by more than one field (WebSearch) *) more internationalization of the search engine messages (WebSearch) *) new language: Norwegian (bokmÃ¥l) *) simple example for converting BibTeX into XML MARC (BibConvert) *) new optional --with-python configuration option *) Python module detection during configure *) bugfixes: os.tempnam() warning, login page referer, and others CDSware v0.1.0 (DEVELOPMENT) -- released 2003-12-04 --------------------------------------------------- *) development branch release *) search engine redesign to yield five times more search performance for larger sites (WebSearch, BibWords) *) fulltext indexation of PDF, PostScript, MS Word, MS PowerPoint and MS Excel files (WebSearch) *) integrated combined metadata/fulltext/citation search (WebSearch) *) multi-stage search guidance in cases of no exact match (WebSearch) *) OAI-PMH harvestor (BibHarvest) *) bibliographic task scheduler (BibSched) *) automatic daemon mode of the indexer, the formatter and the collection cache generator (BibWords, BibFormat, WebSearch) *) user management and session handling rewrite (WebSession) *) user personalization, document baskets and notification alert system (WebBasket, WebAlert) *) role-based access control engine (WebAccess) *) internationalization of the interface started (currently with Czech, German, English, Spanish, French, Italian, Portuguese, Russian, and Slovak support) *) web page design update (WebStyle) *) introduction of programmer-oriented technical documentation corner (WebHelp) *) source tree reorganization, mod_python technology adopted for most of the modules CDSware v0.0.9 (STABLE) -- released 2002-08-01 ---------------------------------------------- *) first "public" alpha release of CDSware *) recently standardized Library of Congress' MARC XML schema adopted in all CDSware modules as the new default internal XML file format (BibConvert, BibFormat, BibUpload, WebSubmit, WebSearch) *) support for OAI-PMH v2.0 in addition to OAI-PMH v1.1 (WebSearch) *) search interface now honors multiple output formats per collection (BibFormat, WebSearch) *) search interface now honors search fields, search options, and sort options from the database config tables (WebSearch, WebSearch Admin) *) search interface now honors words indexes from the database config tables (BibWords, WebSearch) *) easy reformatting of already uploaded bibliographic records via web admin. tool (BibFormat Admin/Reformat Records) *) new submission form field type ("response") allowing greater flexibility (WebSubmit) [thanks to Frank Sudholt] *) demo site "Atlantis Institute of Science" updated to demonstrate: Pictures collection of photographs; specific per-collection formats; references inside Articles and Preprints; "cited by" search link; published version linking; subject category searching; search within, search options, sort options in the web collection pages. - end of file - diff --git a/RELEASE-NOTES b/RELEASE-NOTES index 6264a68c7..da10c7620 100644 --- a/RELEASE-NOTES +++ b/RELEASE-NOTES @@ -1,73 +1,759 @@ -------------------------------------------------------------------- -Invenio v1.1.5 is released -March 2, 2015 +Invenio v1.2.0 is released +March 3, 2015 http://invenio-software.org/ -------------------------------------------------------------------- -Invenio v1.1.5 was released on March 2, 2015. +Invenio v1.2.0 was released on March 3, 2015. -This stable release update is recommended to all Invenio sites using -v1.1.4 or previous releases. +This new stable release introduces new Invenio release series v1.2. +Invenio v1.2 brings over 1200 commits on top of Invenio v1.1, authored +by over 50 contributors. Invenio v1.2 contains many new features and +improvements, such as the new document model, the new authority record +control, and much more. Invenio v1.2 is recommended to all Invenio +installations using v1.1 or previous stable release series. What's new: ----------- - *) BibCirculation: get_book_cover quick fix (#2578 #2653); fix for - wrong non-borrower message (#2597) + *) BatchUploader: apache error codes; insert or replace mode; + authorize via CIDR; add holdingpen directory; several + improvements; bibtask logs via email (#1255); multiple + improvements (#603); fix for permission checking (#1747 #1748) - *) OAIHarvest: remove_duplicates and regexp fixes (#2300 #2608) + *) BibAuthorID: user prefs and session fix; inactivation of + test_save_matrix() (#1678); merge and manage fixes; caches badly + stored in user settings; fix 'create new person' ticketing issue; + leftover print statement; disables debug output; Claiming page is + now reloaded after commit.; hepnames match; + add_cname_to_hepname_record(); hotfix in name comparison; remove + changes tempfile.rootdir; graceful external system query; adds + webuser user merge utility; fix arXiv redirect link; improvements + and bug fixes; improvements and bug fixes; DOIs from ORCID check; + WaP daemon and BAI interface fixes; fix in templates handlers; + hotfixes for authorpages and webauthorprofile daemon; Help pages + and messages; a new hope; use defaultdict from containerutils - *) WebBasket: better formatting of deletion message (#2449) + *) BibAuthority: new names for authority collections; source file + mode fix; separate Authorities collection (#1605); initial release + (#1602); fix for unit test suite - *) docker: initial release (#2736) + *) BibCatalog: ticket_id type is now string (#2096); better error + reporting; requestor on ticket submit; ticket_submit() docstring + update (#2094); improve RT search error handling; return empty + list if no search params; RT discovery; email content cleanup; bug + fix; pylint fixes; refactoring; adds bibcatalog bin to ignored + files; add daemon task (#1528); default email backend (#872); new + email ticketing backend (#872) - *) docs: initial release of CONTRIBUTING guide (#2163) + *) BibCheck: $$9 bibcheck to DOIs (#1955); improvements in DOI checks + (#1955); allow filtering by subfield contents (#2474); last_run + correct update; properly cumulates records; compatiblity with + dateutil 2.2; improve url plugin and tasklet; improve url plugin; + adds --config option; improve exception handling crossref queries; + add retry download to crossrefutils; improve doi plugin; avoid + checking dummy records; add option to consider deleted records; + new BibCheck module - *) installation: MathJax distribution location update (#2732); - explicit jQuery plugin versions (#11 #2655); disable SSLv2/SSLv3 - in Apache config (#2515) + *) BibCirculation: library creation and other fixes (#2550 #2551 + #2552 #2562 #2373); fix for CERN returnees; fix for typo; missing + web tests; minor spelling error fix; fix for mandatory library + type (#1519); email ID changes and test fixes (#1479); admin guide + cleanup; patron-driven acquisition and more (#1280); personid CERN + attribute; ILL improvement; CERN LDAP improvements (#1186); set + colour of some buttons; fix for ILL title and request type; fix + for library ID variable name; various updates; fixed notes link; + code cleaning; better ill/purchase search; auto-fill for purchase + request; remove reference to apache_user; optimize CERN LDAP + query; temporary barcode for new copies; extended ILL to manage + acquisition; make statuses customizable; lots of small fixes; + 'cancelled' status for ILL request; sorting last issued loans; + edit ill request details; loan and renew process enhancement; + added budget_code to crcILLREQUEST; edit library type; arrival + date and library merge; extended item statuses; improved + book_title_from_MARC; fixed multi-barcode loan; fixed user + interface loan renewal; pylint and kwalitee cleaning; small fixes + on printing & intrface; daemon for overdue letters; email alerts + for new requests; delete a copy of a book; added CERN id in + borrower profile (#207); use new URL handler for admin pages; + avoid multiple loan creation (#305) + + *) BibClassify: ontology cache check improvement (#2672); always use + invenio code; raises an exception if rdflib is missing; unit tests + temp dir fix; remove ability to run as standalone (#1459) + + *) BibConvert: lxml support for local document() (#2497) + + *) BibDocFile: pickle support fix (#2549); decompose_file_url() and + subformat (#2556 #2557); bibdocfile.BibDoc memory fix (#2082 + #2136); change name failure raises exception (#2071); more robust + decompose_bibdocfile_url() (#1957); escape file URLs in /files tab + (#2067); fix type of bibrec-bibdoc connection (#1759); get_icon() + for smallest size icon (#1350 #1743); undefined variable fix; + register downloads with recid (#1831 #1832); new web tests; + bibdocmoreinfo query typo fix (#1706); textification with OCR fix + (#1676); get_file() exact_docformat support; display counts in + tabs; fix "delete" CLI option; no access to filesystem; preferred + extension (#1619); load plugins at global level; migration script + fix; fixes wrong variable name; error reporting changes; CERN AFS + awareness (#1388); retry mkstemp in case of failure; CERN AFS + awareness (#1388); fix for bibdoc unattached to record (#1551); + improve BibDoc display in Files tab; raise exception in + _build_file_list(); additional mimetypes support; fix version in + register_download() (#1532); fix for BibDocFile instantiation + (#1317); implements format renaming (#1318); allow doctype + renaming (#980); revert md5 property patch (#1249); new document + data model; fix for display of hidden icons; change_name missing + parameter fix (#1818) + + *) BibEdit: only notifications on error; kwalitee improvements; add + email notification on submit; user name in BibSched column; + wrongly displayed HP changeset bug; autocompletion of fields from + KBs (#1258 #73); author names into history revisions; duplicate + code removal; new RT ticket through UI dialog; int object is not + iterable fix; InvalidCache exception on clone; modal submission + preview window; check for record in BibSched queue fix; debugging + all user actions; holding pen fix; prevent deletion of managed + DOIs fields (#1445); fix revert when no 005 in history; Holding + Pen fix; add AJAX profiling option; adds affiliation guessing; + bibHOLDINGPEN from TEXT to longblob; bibupload xml file path + conflicts; support for simple ticketing; small merging fix; + BibEdit web test improvements.; fix textmarc2xmlmarc unit test; + record from history instead of bibfmt; BibCatalog and other + improvements; fixes errors in case of deleted records; several + bugfixes; moves files cache to the database; open DOI source in + new window; fixes pdf detection; several improvements; HoldingPen + multiple improvements; update + CFG_BIBEDIT_EXTEND_RECORD_WITH_COLLECTION_TEMPLATE; fixes date + parsing problem; hide authors when they exceed max number; + multiple fixes and improvements (#1190); send latest timestamp + when reverting; update admin help page and shortcuts; remove extra + holding pen call; show/hide specific parts of the record; merge + record with template; custom errors for AJAX requests; better + holdingpen integration (#87); tab switch between fields; minor + fixes; fix perform_doi_search function; refactoring and fixes; use + perform_request_search on search; add version to bibedit css name; + sort HoldingPen changes alphabetically; add direct link to + dx.doi.org; save changes periodically; avoid sync request to see + if record has pdf; change cache folder; amend textmarc to xmlmarc + unit test (#1269); import CrossRef data; improvements and fixes + (#761 #1032); css changes; allow opening deleted records (#573); + delete cache if record not modified; add extraction of references + from URL; several fixes; introduce textmarc editor; cnum + generation on conference records; multiple improvements (#696); + revert to master version (#792 #63 #118 #125); fix return binding + on Jeditable cells; fix jEditable callback when pressing return; + fix input default value; disable preview button when reverting + record; fix jEditable callback when pressing return; hide delete + record button by default; add field in specific position (#583); + fix apply all HP changes (#125); clean JavaScript code (#63); + extract css into a separate file (#118); upgrade to jQuery 1.5 + + *) BibEditMulti: only notifications on error; add email notification + on submit; adds support for hidden fields (#707); allow non- + delayed processing and priority change; several improvements; + display all MARC fields (#1489); fix for multilanguage interface + (#1331); multiple improvements and fixes (#1146 #1147 #1148 #1130 + #1149 #1156 #1158) + + *) BibEncode: support for FFmpeg >= v0.9; updated for latest + BibDocFile APIs; fix uuid Python 2.4 compatibility (#1478) + + *) BibExport: update Google Scholar exporter; hidden files and + recrawling + + *) BibField: new CFG_BIBFORMAT_HIDDEN_RECJSON_FIELDS (#2197 #2396); + better create_record error catching (#2510); fix copyright field + names (#1933); backported improvements from pu (#1687); no caching + of calculated fields; change recid field type to integer (#1633); + improvements backported from next; fix number_of_copies field + (#1625); new upgrade recipe to remove json cache; new field + filtering for `get_record`; elimination of None values in recjson; + `schema` in `split_blob`; `is_empty` update; fix for '__eq__' to + better compare recs; fix for `is_type_isbn`; continuable vs fatal + errors; bibdoc integration; new decorator @only_if_master_format; + better handling of calculated fields; fix for misbehavior when + parsing rules; new producer section added to config; clean up of + atlantis.cfg demo file (#1557); volume subfield addition; creation + date addition and keyword fix; new fft field in `atlantis.cfg`; + Python-2.4 compatibility fix (#1533); legacy_export_as_marc + escaping fix (#1509); new calculated fields; virtual field aliases + amended (#1530); new @persistent_identifier "decorator" (#1500); + bug fixes when using decorators (#1502); fix for lxml + compatibility; Python-2.4 compliance; initial release (#1300) + + *) BibFormat: new BFO for authority records (#1699 #1749); links to + public resources of authors (#1700 #1749); better display of + authority records (#1749 #1699); ORCID display for authors; + removal of obsolete BFX engine (#2563 #2124); recjson update using + bibreformat (#1708 #2220); PEP8 fixes in bibreformat (#2220); add + sponsor information to copyright (#1975); larger column + `format.code` (#2072); advertise /doi URL in DC output; improve + Dublin Core output (#320 #1213); configurable /record; new + bfe_oai_identifier element; new bfe_date parsing/formatting + options; plot file identification improvements (#1514); fix for + eval_format_element return type; file rights fix; new + bfe_arxiv_link; affiliation improvements; left over print in + format_record; reworks exceptions handling; only save default site + lang on the fly; look for missing caches by default; fix snippet + generation; needs_2nd_pass in bibreformat; duplicate code in + bibreformat.py; improves and updates bfe_plots; fixes tests; fix + external function for libxslt; improve Google Scholar support + (#1513); Displays the DOI in the EndNote; dublin core export now + includes DOI; to fixup to removes old php format; small fixes; + several fixes; fix in date comparison; second formatting pass + (#1464); lazy missing formats updates; empty record check; + progress display improvement; initial example of Twitter Card + support; fix for snippet generation; author links for mobile app; + initial release of mobile app formats; new Solr fulltext snippet + facility (#1301); QR-code format element (#1441); add DataCite XSL + stylesheet; remove 0248_a field from title; fixes last run date + for HDREF (#1236) + + *) BibIndex: ambiguous SQL query fix for MariaDB-5.5 (#2759); + tag.recjsonvalue NOT NULL (#1947 #2259); fix new-old record + incremental indexing (#2693); clean up after authority regression + test (#2448); author ID performance improvements (#1952); upgrade + recipe for `tag.recjson_value`; recjson fields in admin interface; + indexing non-MARC standards; abstraction layer for terms + retrieval; WordTable API changes; move helper functions to utils + file; changes in WordTable argument list; PEP8 compliance fixes; + fix for virtual index filtering; new DOI index (#1655); virtual + index queue dupe optimisation; new 'all-virtual' CLI option; minor + engine refactoring; documentation for virtual indexes; new pattern + for tokenizer inheritance (#1704); new abstract class for indexes; + separate class for virtual index (#1661); common words in virtual + index (#1653); fixes admin regression tests; + BibIndexDefaultTokenizer upgrade; bad word check optimized; + consistency check optimizations (#1436); ingestion health and + "unneeded" indexes (#1632); index type in admin interface; virtual + global index (#1574); indexing only affected indexes (#1573); + clean warning messages in test suite (#1615); filetype and + itemcount tokenizer fix (#1609); new index 'filetype' (#473); new + index 'itemcount'; tokenisation of authority records; fix syntax + error in bibstat; support for CJK languages (#285); pluginutils + for tokenizers (#852); centralisation of tokenizers (#852); new + regression tests; centralisation of LaTeX/HTML treatment (#852); + centralisation of stopword treatment (#852); centralisation of + synonym treatment (#852); fix for external fulltext indexing; + rework of error handling (#1075); move of text extraction to + BibDocFile; new exacttitle index (#1397); new filename index + (#1717) + + *) BibKnowledge: searchtype parameter in KB export (#2570 #2581); fix + get_kbt_items_for_bibedit (#1879 #1895); lxml port + get_kbt_items_for_bibedit + + *) BibMatch: allow tests to login over plain http; Fix validator + problem; use other author comparison function; more print + statements; improves get_longest_words; improve fuzzy queries; + validation fixes + + *) BibMerge: adds CFG_SITE_RECORD as script data (#2580 #2237); + `onclickSubmitButton` missing comma fix (#2230); prevent loss of + DOI when merging records (#1446); delete cache of master record + before submission; change order of updates; add subfield sorting + and interface fixes; several fixes; add 981__a field to master + record; delete duplicate record first (#1645) + + *) BibRank: fix path for download history graph (#2554 #2374); fix of + similar-to-recid result order (#1745 #2236); missing selfcites for + collaborations; record ID citations catchup; citation blobs in + Redis (#1689); adds a new option to disable bibsort (#1617); minor + refactoring in word ranking; handle missing files when removing + graphs; more leanient date handling in citation graphs; more + leanient date handling in citation graphs; remove outdated import + in citations tab; exception when gnuplot is not available; unicode + recid in citation indexer; Added ISBN, recid and HBL identifiers; + fix bad variable name; fixes for sorting; missing drop table + rnkSELFCITEDICT; new way to generate graphs (#1244); consider only + one year in citation graph; fixes for cited by sort; function to + get citations of a single record; fixes sorting; optimized cited + by sorting; filter citations on collections (#1504); logging of + citation changes (#1426); store selfcites in a table (#1417); + citesummary optimizations (#1481 #1217); handle records with + mulitple journals (#1394); optimized cited by sorting; no citerank + error when no citations (#1624); better Solr regression tests; + faster Solr indexer; new multi-tag Solr indexer; index latest + records first in Solr; increase rnkDOWNLOADS.file_format size; + self cites upgrade recipe improvement (#1482); detect external + word similarity ranker; storing citation indexer warnings in DB + (#1210); optimisations in citation algorithm (#1073); selfcites + fixes; fix for citation indexer checks; citation indexer sanity + checks and alerts (#1091); reference linking improvements (#950); + citation indexer date check change (#946); fix for missing Python + files in Makefile; two algorithms for self-citations (#945); + change import to defining module; better exception handling in + Solr indexer (#1199); better default mode in Solr indexer (#1192); + more invalid Solr character replacements; new Solr and Xapian + ranking bridge (#1084 #1168) + + *) BibRecord: namespaces ignored for lxml (#2604); search & compare + subfields; new API records_identical(); new API + identical_records(); record_get_field_values with filtering + (#1550); filter field instances (#1550) + + *) BibReformat: chunking of updated records query + + *) BibSched: email-logs-on-error parameter (#2205); check schSTATUS + when detecting status; pep8 for bibtask.py; pep8 for bibched.py; + subdirs for bibsched logs; fixes a bug with --profile cli option; + fix priority for the same sequence id; increase max log file size + to 5Mb; display mode for non-periodical tasks; adds more task + changing commands; get_modified_records_since() (#1538); monitor + auto mode selection bug; invalid sql in monitor history tab; + setting to continue on errors; many improvements (#1177 #991); + error when switching to manual; refactoring and improvements + (#1274 #1275 #1449); enhanced write_message(); motd update check; + problem parsing task CLI options (#1330); interface responsiveness + improvements (#1303); priority in automatic mode; CLI-started + tasks host field; kwalitee fixes; shell output leakage upon task + kill (#1343); single error reporting (#1342); scheduling algorithm + improvements (#1281); fixes task chain-sleeping (#1304); fixes + monotasks for multi-node (#1304); fixes for multi-node setup + (#925); new --email-logs-to bibtask CLI (#1252); subprocess + instead of deprecated popen2; new web UI for BibSched live view + + *) BibSort: improved washers (#2283 #1754); add check before + deleting; fix typos and CLI arguments + + *) BibUpload: creation_date based on incoming 005 (#2693 #1604 + #2684); faster recjson deletion after updates (#1708); no reload() + in regression tests (#1702); --append only new fields (#1440); + removed print statement; do not always process MoreInfo; + CFG_BIBUPLOAD_EXTERNAL_OAIID_TAG fix; new + CFG_BIBUPLOAD_MATCH_DELETED_RECORDS (#1438); affected fields and + insert mode; 8564_s support; less useless computation; less + verbose; messages cleaning; ingore 856 tag order in conflict + (#1606); smarter conflict report; smarter conflict detection; no + tickets in pretend mode; ticket creation fix; improves utf-8 + checks; task error messages (#1449); utf-8 encoding; encoding + checks; regression tests cleanup; matching existing records + (#1438); pretend holding pen fix (#1618); fill affected_fields in + hstRECORD (#1572); fix for inserts with 005 (#1595); conflicting + revision ticket queue; smart record uploader fixes; BibCatalog + connection; sensible history and other goodies (#498 #1250 #871); + bibrec timestamp bug (#1431); smart record uploader (#816 #864 + #897); check DOI uniqueness (#1160) + + *) DocExtract: new CMS PAS report numbers; additional report numbers; + extract page-end from references; removes stdout ouput from tests; + rework of regression tests; fixes regression tests; improves + bibrecord; increases compiled regexp cache size; preload + docextract author regexp; using -i instead of -r; preload kbs on + wsgi load; re-enable caching of kbs; outdated import in webtool; + reduce verbose in tests; fixes DESY-THIS rn recognition; 5 digits + arxiv numbers detection; do not create old tickets; lower + bibupload priority; webinterface text box fix; optional unidecode + dependency; help messages & compatibility warnings (#1220); + several improvements; move mislabelled regression tests (#1309); + journal rawref search fix (#1306); nose-friendly refextract tests; + fix reference extractor unit tests; refextract unit tests file + name fix; preparing for merging into master; multiple fixes (#966 + #958); new docextract and refextract modules (#944 #1014) + + *) HepData: updates to formats; fixes unit tests; clean hepdata.js + inclusion; new HepData module; adds hepdataharvest bin to ignored + files + + *) HepNames: update form migrated to INSPIRE + + *) I18N: PO file update for the release of v1.2.0; more complete + POTFILES.in; fix wrong msgids in Persian translation; updates to + the Persian translation; POTFILES.in update; initial Persian + (Farsi) translation; infrastructure for Persian (Farsi); several + fixes in Spanish translation; Catalan and Spanish updates to + Search Guide; Catalan and Spanish updates to Search Tips + + *) InvenioConnector: allow logins over plain http; fix for CDS + authentication + + *) OAIHarvest: fix identifier parsing (#2408); conversion argument + name upgrade (#1753); error reporting fix (#1804 #1812); respect + hidden fields; do not launch BibIndex when done; bibindex priority + to 4; only update lastrun on successful harvest; small daemon + enhancement; fixes missing import; priority of single harvest + tasks; improves arXiv identifier harvesting; several improvements + (#547); sample OAI-ArXiv conversion update (#678); CERN-specific + "arXiv" doctype; consider source_id for selective post-processing; + configurable selective post-processing (#1477) + + *) OAIRepository: lower priority to updating uploads (#2525); fix for + hidden OAI tags (#2642); more lenient time limit for tests; do not + report cache not found errors; allows running slow machine; + oai_get_recid() for merged/deleted records (#1429); marcxml + created in shared directory; forcing clients to re-harvest (#1218) + + *) PdfChecker: clean up after regression tests (#2448); log full list + of updated recids; skip records without unique ids in 037 tags; + new module for arxiv pdf checker + + *) RefExtract: avoid double encoding (#2602); refactored book + handling; improved book search; addresses warning in tests; + removes leftover print; only accpet digits as numeration; allows + more lines between title and numeration; changes condition for + ticket creation; improves docextract, refextract + + *) SolrUtils: fix of similar-to-recid result order (#1745 #2236); + better exception handling in indexers; faster snippet factility; + support entire full-text indexing; cleaner schema.xml; support + high count of logical clauses + + *) WebAccess: automatically fetch SSO nicknames (#2583); CERN- + specific authorization message; fixes user details page links; + CFG_ACCESS_CONTROL_LEVEL_SITE=1 support (#1501); remove Facebook + testing credentials; update check for "external" account at CERN; + ORCID support (#1124); OpenID and OAuth authentication (#1124); + new CERN auth method support + + *) WebAlert: update tests for newly introduced records + + *) WebApiKey: unit Vs. regression tests + + *) WebAuthorList: fix import from recid; fix import from record id; + ignore empty affiliations when exporting; add new author list + manager tool + + *) WebAuthorProfile: reenable profile pages; disable if not + available; compatiblity with atlantis; fixes unit tests; recompute + link as a post action; new regression test suite + + *) WebBasket: 'move item' improvements; new 'move item' functionality + (#1547); Create Basket link in the main display (#1333); correct + referer when adding to basket (#1194); fix copying external items + + *) WebComment: fix for get_first_comments_or_remarks (#2522 #2523); + more prominent subscription link (#2434); deleted record message; + "Your Comments" page; link to "Your Comments" after posting; "Your + Comments" page (#974) + + *) WebJournal: Indico seminars widget improvement (#1980 #1981); fix + image dimension retrieval; sample Twitter Card markup; new image + template; better exception handling when caching; structured cache + (#1544); CERN-specific fix; fix for what's new widget test case + + *) WebLinkback: safer notification email; clean regression test suite + (#1285); fix for importing CFG_DATABASE values; pending linkback + notification emails (#1247); minor improvement; better + documentation; module optional (#1245); better global /linkbacks + page; better /linkbacks tab display; better URL title display; fix + for DB name in regression tests; fix for user_info passing; unit + test module rename; auto-increment regression test fix (#1136); + initial release (#627 #857 #1136); fix truncated FSF address in + docstring + + *) WebMessage: English corrections in output messages (#1849) + + *) WebSearch: optional refersto/citedby record limit (#2711); removal + of hard-coded Holdings tab (#2592 #2664); new test case for + pattern-limit queries (#1750 #1751); search results pattern limit + fix (#1750 #1751); proper re-raise in RSS handling (#2084 #2598); + fix for the number of printed records (#2512); inverted collection + scores (#2058); stemming and '*' (#2468); smarter journal hint + (#2352); new Journal Hint Service (#2352); kwalitee fix (#2352); + richer `/record` and `/search` API docs (#2303); fix for record + numbering in pagination (#1762 #1763); new Add-to-Search Interface + (#622 #271 #1738); CERN-specific video latest additions (#2068); + CERN-specific lecture latest additions (#2068); improve detection + of record owners (#2068); better retrieval of record tabs (#2068); + fix IndexError in is_hosted_collection (#1764); CERN-specific hack + for latest additions (#1976); CERN-specific collection sorting + (#2017); fix for 'rhs is of unknown type' (#1819); resolve + (internal) DOIs (#1322); anyfield in CFG_WEBSEARCH_SYNONYM_KBRS + (#1493); faster collection children cache (#1739); initial support + for recjson output; fix detailed record page tab tracebacks; + update collection page markup; fix search URL in timeout message; + CERN-specific collection sorting; better sort order in citation + tabs (#1307); timestamp detection fix for empty sites; sorting + fixes (#1674); reverse order and scores; rg parameter with + of='id'; reworks async downloader; wgsi.errors in fake request; + handle case in /collections/ urls; fixes + regression tests; stdout.flush conflicting with mod_wsgi; changes + citation tab count; search API changes for record sorting (#1657); + fix sorting options (#801); spires date parsing errors fixes; no + 'back to search' on empty session; display deleted records in + citation log; make query parser use Invenio datetime; fix mixed + parameter for re.sub(); bibfmt on innodb; outdated import in + citations tab; takes into account new record in tests; fix HepData + templates; change CFG_SITE_URL to CFG_BASE_URL; fixes search bug + with --empty hitset; add cataloguer: search unit; SPIRES date + format 11/93; change CFG_SITE_URL to CFG_BASE_URL; testing fixing + subject lookup; add record edit link in brief; pep8 fixes; INSPIRE + vol to use volume field; INSPIRE texkey in 035__%; handles + selfcites searches; spires syntax and quotes; INSPIRE fulltext + warning update; find doi in search engine (#1051); CV output + formats (#314); correct record sums from hosted colls (#1651); + search services (#1278); custom i18n collection boxes (#1286); + item count regression test activation; fix for hidden-field admin + access test; support for intbitset output format (#1460); fix + missing cc info in req object; CERN-specific hack update; display + number of hits in mobile output; Greek translation of Search + Guide; fix Python 2.4 syntax error; most popular field values + optimisation (#1096); fix Search Guide reformatting; fix Search + Guide mismatch tags; Search Guide reformat and pretty-print; fix + browsing deleted/restricted records (#1292); webcoll performance + improvements; permitted restricted colls for guests; empty unit + test suite for summarizer; removal of excess summariser tests; + revamping of citesummary pages (#134); summarizer unit test + update; fix searching with limits; enforcement of record view + restrictions; translation-friendly overview box; restricted record + search improvements; fix for regression test link targets; fix for + double display of the footer; better restricted collection search + (#1161); "p=el*;rm=citation" test inactivation (#1174); sorting + test amendments; mixed ranking/sorting test amendments; wildcard + limit parameter is 0 in p_r_s; bugfix for empty set sorting; + refactored perform_request_search() (#542); add regression tests + for "em" parameter; add "em" parameter; include 'cc' in RSS + 's (#2013 #2014); fix for "--language" option + (#1399 #2219) + + *) WebSession: no differentiation between guests (#2786 #2813); CSRF + token in profiling settings (#1855); disable ORCID login (#1667); + user preference to enable profiling; new Redis session storage + backend (#1688); fixes session_cleanup; session_param_get() + default value (#1294) + + *) WebStat: fix for custom query summary graph (#2553 #2375); default + query in the Custom query summary (#2388); list link fix for + system health UI page (#1713); ingestion health monitor fix + (#1631); use Invenio instead of CDS in pages; new ingestion + monitor (#936); no wildcard limit for custom summary data; add + bibcirculation config variables + + *) WebStyle: richer documentation on record page tabs (#216); ping + handler returning 200 status code (#2700); POST handling fix + (#1951); req object with no headers; fix gotoadmin CLI parmeters + parsing (#1427); move charset higher in the document; move of lang + and dir attributes to html; fixes for /goto CERN-HR plugin + example; silence client disconnected errors; blocking read in + handle_file_post; add missing icons to Makefile; + WebInterfaceDisabledPages(); quote canonical and alternate URLs + (#1515); /info pages using webdoc infrastructure; more accurate + "Restricted" flag display (#867); inactivate two regression tests + (#1293); goto engine typo fix; canonical and alternate URLs (#1251 + #368); new /goto URL handler (#1178); memory leak fix in session + handling (#571) + + *) WebSubmit: Set_Embargo optional and functional (#2699); link to + successfully created record (#1641); more robust JavaScript check + (#1741); print white space instead of None (#1741); support for + elements' custom_level (#1741); `test_revise_picture_admin` test + fix (#2142); `deferRelatedFormatsCreation` param fix (#2142); + Link_Records error message fix (#1734); fix access restrictions in + /uploadfile (#1703 #2066); allow record owners to upload files; + allow image conversion of .tiff (#1909); grant access to the + superadmin as owner (#2065); doilookup function in webinterface + (#2025); guests support improved in /direct URL (#1240); rotate + created icons according to EXIF (#1516); web tests for DEMOART and + DEMOPIC; DEMOART uses bibdocfile_managedocfile; skip pdf + optimization if pdfopt is missing; fixes for openoffice handling; + INSPIRE specific amendments; add traceback info on error; new + Run_PlotExtractor function (#1506); source file mode fix; login + offer to guests on action page; fix for icon creation for + bibdocfiles; jquery-ui update for photo submission + + *) containerutils: new Python-2.4 defaultdict + + *) crossrefutils: new Fundref-based APIs + + *) dataciteutils: refactor DataCite API wrapper (#1457); DataCite DOI + support and test cases + + *) dateutils: adds __add__ to our custom datetime; strptime for + Python-2.4 compatibility; fix for strftime() function; consolidate + localtime_to_utc; day ranges; fix for unit test suite; new + get_time_estimator function + + *) dbdump: partial dumps; ignore with regexp (#579); dump on detached + slave (#1282); fix compress mode; add option to ignore tables; add + slave support; improve error handling + + *) dbquery: fix for importing CFG_DATABASE values; more reinstall- + friendly dbquery + + *) demo site: fix double 245 MARC field + + *) docker: more complete configuration + + *) errorlib: Sentry logging improvements (#2535 #2546); tags context + fix for sentry (#2623); fix Sentry context syntax issue (#1960 + #2147); context support in sentry (#1960 #2147); support for + Sentry logging (#1726); makes SMS messages shorter; time + independent tests; hostname in error notifications (#1546); wrap + warnings to invenio.err (#1616) + + *) filedownloadutils: add verbose to download_url(); utility for file + retrieval (#1076) + + *) general: new CFG_SCOAP3_SITE flag; optional remote debugger; test + fixes; Propagating exceptions in debug mode; unit-tests fixes + + *) git: ignore KDevelop4 project files + + *) global: PEP-8 style in block comments (#1904); test suite original + modification date fix (#2737); removal of INSERT DELAYED SQL + statements (#2268 #2269); removal of leftover files; + InvenioTestCase in test suite (part 2); InvenioTestCase in test + suite; cdsweb.cern.ch becomes cds.cern.ch + + *) htmlutils: render MathML by MathJax; improve js string escaping + + *) importutils: fix None values error; Makefile clean up; Python 2.4 + support and test case; initial release + + *) installation: new release_1_2_0 upgrade recipe; + 2015_03_03_tag_value upgrade recipe; 2013_09_16_aidPERSONIDDATA + fix; 2014_08_12_format upgrade recipe fix; all upgrade recipes in + tabcreate (#1753); richer uninstall-jquery-plugins (#2418); + python-twitter requirement update (#2015); lxml recommended; + location of demo_table_jui.css; location of jquery.omniwindow.js; + location of jquery.blockUI.js; location of sly.min.js; location of + parsley.js; Redis and Nydus pre-requisites; jinja2 prerequisite + (#1677); move h5py to extra requirements; h5py requirement clean- + up; update to MathJax-2.3; add h5py dependency; use custom faster + jeditable; ColVis.js on invenio-software.org; table creation fix; + Python-2.6 and pip requirements; fix for BibAuthority upgrade + recipe; fix for rnkDOWNLOADS upgrade recipe; help for BibAuthorID + email settings; support for Apache-2.4 (#1552); help for `--load- + bibfield-conf` step; oaiREPOSITORY_last_updated upgrade; fix for + table drops and upgrades; selfcites upgrade recipe add-on; more + gentle idxINDEX.indexer recipe; maint-1.1-to-master upgrade recipe + (#1198); fix for 2012_10_29 upgrade recipe; fix for duplicate /css + alias + + *) intbitset: initialization from iterator (#1698); no crash when + intbitset is on rhs (#1287); atomic installation; union() and + isdisjoint() support; type checking for operators + + *) inveniocfg: adds option to failt tests on first error; restore + wrapping showarning after running unit tests; do not capture + warning in unit tests; workaround bibfmt corruption; fixes + BibSched check in upgrader; new derived config CFG_BASE_URL + + *) inveniogc: guest users gc optimization (#428 #1950); clean up gc + tasks (#1950); delete refextract logs after 7 days (from 28); + BibEdit related improvements.; add new session deletion mode; + delete BibEdit temporary files + + *) kwalitee: even stricter PEP-8 compliance + + *) mailutils: better email header type detection (#2713); support + invalid senders (#2256 #2385); fix for send_email() error on DEV + site (#1744); extend send_email with BCC option; send_email() with + attachments (#1253) + + *) mathpreview: js-based math preview panel (#1221) + + *) oaiharvest: fixes harvest() web interface (#2524) + + *) plotextractor: recid parsing fix (#2566); sanity in plotextractor + tests; do not add FFT if there is no location; remove dummy + caption generation; fixes arg parsing and more; more shell + argument escaping; process files of a record; fix CLI parameters + parsing + + *) redisutils: initial release + + *) sequtils: increases size of seqSTORE.seq_value; no texkey if no + year; increases size of seqSTORE.seq_value; fix texkey generation; + add start_date parameter to CnumSeq; wait for BibUpload to finish; + new seq generator for texkeys + + *) shellutils: Mac OS compatibility (#1184) + + *) solrutils: clean unit and regression test suite (#1284); add + search and ranking tests; fix for ranking result display; better + collection filter generator; removal of unused code; better + invalid character handling (#1197); add documentation + + *) testutils: wait for element to be displayed/hidden; default to + assertEqual in py26; add new relative url function; + regression_tests fix; new JavaScript unit test framework + + *) textmarc2xmlmarc: remove content regexp check (#1267) + + *) textutils: wash_for_utf8() simplification (#1755); + translate_to_ascii() unknown chars fix (#1754); show_diff() API + clean-up (#1465); fix old import statement; sharp-s to ss; + unidecode verision; add ALA-LC transliteration (#1092); create + function to show diff view + + *) urlutils: new function get_relative_url(); use hashlib instead of + md5 if possible + + *) xmlmarc2textmarc: order only by tags Download: --------- - - - + + + Installation notes: ------------------- Please follow the INSTALL file bundled in the distribution tarball. Upgrade notes: -------------- +We recommend to test the upgrade on a development server first. Please proceed as follows: a) Stop your bibsched queue and your Apache server. b) Install the update: - $ tar xvfz invenio-1.1.5.tar.gz - $ cd invenio-1.1.5 + $ tar xvfz invenio-1.2.0.tar.gz + $ cd invenio-1.2.0 $ sudo rsync -a /opt/invenio/etc/ /opt/invenio/etc.OLD/ - $ sh /opt/invenio/etc/build/config.nice + $ sh /opt/invenio/etc/build/config.nice # (1) $ make - $ make check-upgrade - $ sudo -u www-data make install - $ sudo rsync -a /opt/invenio/etc.OLD/ \ - --exclude invenio-autotools.conf \ - /opt/invenio/etc/ # (1) + $ sudo -u www-data make check-upgrade + $ sudo -u www-data make install # (2) + $ sudo diff -r -u /opt/invenio/etc.OLD/ \ + /opt/invenio/etc/ # (3) $ sudo -u www-data /opt/invenio/bin/inveniocfg --update-all - $ sudo -u www-data /opt/invenio/bin/inveniocfg --upgrade + $ sudo -u www-data /opt/invenio/bin/inveniocfg --upgrade # (4) Notes: - (1) If you are upgrading from previous stable release series - (v0.99 or v1.0), please don't run this rsync command but diff, - in order to inspect changes and adapt your old configuration - to the new Invenio v1.1 release series. + (1) If you are upgrading from previous Invenio stable release + series, you may need to upgrade your system packages. For + example, Python-2.6 is now the minimal required Python + version. Hence you may need to run: + + $ sudo pip install -r requirements.txt + $ sudo pip install -r requirements-extras.txt + $ ./configure ... + + as indicated in the INSTALL file. + + (2) After installing new files from the release tarball, you will + most probably also want to upgrade your jQuery and other + runtime dependencies, by running: + + $ sudo -u www-data make install-jquery-plugins + + and similar statements as indicated in the INSTALL file. + + (3) Due to many new features brought by this new release series, + please study the configuration changes carefully. You may + need to adapt several CFG variables, `etc` files, and any + local templates you may have customised previously. We + recommend to test the upgrade carefully on a development + server. + + (4) This command will perform the database upgrade, which may take + considerable time due to upgrading the document model. Note + that the command will also inform you about any further + actions you should take, for example you may be asked to run: + + $ inveniocfg --load-bibsched-conf + $ inveniocfg --reset-recjson-cache + $ webcoll -u admin -f c) Restart your Apache server and your bibsched queue. - end of file -