diff --git a/AUTHORS b/AUTHORS index 895008abe..ce32dd71d 100644 --- a/AUTHORS +++ b/AUTHORS @@ -1,294 +1,303 @@ Invenio AUTHORS =============== Invenio is being co-developed by an international collaboration comprising institutes such as CERN, CfA, DESY, EPFL, FNAL, SLAC. The CERN development team currently consists of: - Jean-Yves Le Meur - Team leader. + CERN Digital Library Services team leader. - Tibor Simko - Head Developer. General system architecture, release management. + CERN Digital Library Technology team leader. Head Developer of + Invenio. General system architecture, release management. WebSearch, BibIndex, BibSched, WebStat, WebStyle, WebSession, WebHelp, and more. - Jerome Caffaro BibFormat, redesign and rewrite in Python. BibConvert XML-oriented mode. OAI harvester improvements. Improvements to BibEdit. WebDoc tool. WebJournal refactoring and rewrite. WebComment rounds and threads. WebSubmit asynchronous upload support. Improvements to numerous modules. - Samuele Kaplun Authentication and user preferences rewrite and improvements. Firewall-like access control RBAC system. Fulltext file management rewrite and upload feature. Intbitset Python C extension for the indexer. Improvents to the task scheduler and session hander. Improvements to numerous modules. - Ludmila Marian Citerank family of ranking methods. Fixes to numerous modules. - Chris Montarbaud Multimedia and photo management. - Belinda Chan User documentation for personal features like alerts and baskets. - - Marko Niinimaki - Contributions to the BibRank citation module and WebSearch - summary output formats. Initial implementation of BibCatalog and - BibKnowledge. - - - Piotr Praczyk - OAI harvesting from arXiv. Test harvesting interface, for - BibHarvest. Record comparison library functions, for BibRecord. - Numerous improvements to BibEdit, e.g. holding pen, copy/paste, - undo/redo. - - - Christopher Hayward - Improvements to the reference extraction tool. - - Jaime Garcia Llopis Improvements to the BibCirculation module. + - Flavio Costa + Contributions to the Italian translation. + + - Jiri Kuncar + Contributions to the Czech translation. + - Jan Aage Lavik Improvements to BibMatch with remote matching capabilities, improvements to plot extractor, improvements to harvesting and other small fixes. - - Jan Iwaszkiewicz - Full-text snippet feature for full-text search. - - - Jocelyne Jerdelet - Updates to `Howto MARC' guide. - - - Juan Francisco Pereira Corral - Fix taxonomy regression test, for BibKnowledge. + - Piotr Praczyk + OAI harvesting from arXiv. Test harvesting interface, for + BibHarvest. Record comparison library functions, for BibRecord. + Numerous improvements to BibEdit, e.g. holding pen, copy/paste, + undo/redo. - Roman Chyla WSGI handler accepts UTF-8 strings. - Samuele Carli Fixes for basket export facility and adding external items to baskets. - - Tony Ohls - Fixes for regexp treatment in BibConvert. + - Annette Holtkamp + Updates to `Howto MARC' guide. + + - Jocelyne Jerdelet + Updates to `Howto MARC' guide. The EPFL development team currently consists of: - Gregory Favre Rewrite of WebBasket. WebMessage. Improvements to WebComment. Other contributions and improvements. The SLAC development team currently consists of: - - Travis Brooks - Team leader. Support for SPIRES search syntax and other - improvements. - - Joe Blaylock Rewrite of SPIRES query syntax parser, support for nested parenthesis for WebSearch, fuzzy author name tokenizer, enrichment of author pages with h-index. - Mike Sullivan Improvements to author pages. The Harvard-Smithsonian Center for Astrophysics development team currently consists of: - Alberto Accomazzi Team leader. - Giovanni Di Milia Recognition of /record/sysno URLs, ADS formatting. - Jay Luker Improvements to the emergency notification sending facility. - Benoit Thiell Fixes for BibRecord library, detailed record links, improvements to code kwalitee in numerous modules. Improvements to BibClassify. Many former team members (mostly CERN staff and fellows, technical students, diploma students, summer students) contributed to the project since 2002. In an approximately decreasing chronological order: + - Juan Francisco Pereira Corral + Fix taxonomy regression test, for BibKnowledge. + + - Jan Iwaszkiewicz + Full-text snippet feature for full-text search. + + - Christopher Hayward + Improvements to the reference extraction tool. + + - Travis Brooks + Support for SPIRES search syntax and other improvements. + + - Tony Ohls + Fixes for regexp treatment in BibConvert. + + - Marko Niinimaki + Contributions to the BibRank citation module and WebSearch + summary output formats. Initial implementation of BibCatalog and + BibKnowledge. + - Mathieu Barras Initial implementation of SWORD client application. - Fabio Souto Initial implementation of the invenio config dumper/loader. - Pablo Vázquez Caderno Prevent loop in collection trees, for WebSearch. - Victor Engmark Bash completion for inveniocfg, patche for dist-packages. - Javier Martin Moderation tools for WebComment, improvements to BibEdit, initial implementation of the batch uploader. - Nikolaos Kasioumis Hosted collections for WebSearch, rewrite of WebBasket UI, improvements to WebAlert. - Valkyrie Savage Initial implementation of the plot extractor library. - Miguel Martinez Pedreira Tool for manipulated embedded metadata in full-text files. - Jorge Aranda Sumarroca Support for FCKeditor-uploaded files for WebSubmit. - Glenn Gard Implemented many unit, regression and web tests for WebAlert, WebJournal, WebSubmit, WebComment, WebMessage, WebSession modules. - Christopher Parker Improvements to the submission approval workflow. - Martin Vesely BibHarvest, OAI daemon and admin interface. BibConvert text-oriented mode. BibMatch. - Tony Osborne Improvements to the reference extractor. - Radoslav Ivanov Contributions to the WebBasket module test suite. Support for parentheses and SPIRES search syntax in WebSearch. Initial implementation of the multi-record editor. Initial implementation of BibExport. - Joaquim Rodrigues Silvestre Initial implementation of the BibCirculation module to handle physical item copies. - Kyriakos Liakopoulos Initial implementation of BibMerge. Improvements to BibEdit. - Lars Christian Raae Record locking, per-collection curating authentication, reverting older record versions, for the BibEdit. Rewrite of BibEdit in Ajax. - Ruben Pollan Contributions to the WebStat module. - Nicholas Robinson WebSubmit. Reference extraction for the BibEdit module. - Gabriel Hase WebJournal module. - Diane Berkovits Ranking by downloads, for the BibRank and WebSubmit modules. Group management for WebSession. - Joël Vogt Contributions to the BibClassify module. - Marcus Johansson Contributions to the WebStat module. - Jan Brice Krause Original implementation of the fulltext file transfer mode for BibUpload. - Axel Voitier Complex approval and refereeing subsystem, for WebSubmit. - Alberto Pepe BibClassify, BibHarvest Admin. - Nikolay Dyankov XML-based BFX formatting engine, for BibFormat. - Olivier Serres External collections searching, for WebSearch. - Eric Stahl Rewrite of BibUpload in Python. - Frederic Gobry Contributions to the templating system, the URL handler, the gettext infrastructure, the regression test suite infrastructure, numerous patches for many modules. - Krzysztof Jedrzejek Improvements to ElmSubmit. - Yohann Paris BibEdit Admin. - Paulo Cabral WebComment, error library, design of collaborative features. - Thomas Baron WebSubmit and BibUpload. Improvements to BibSched. - Maja Gracco System librarian, MARC21 expertise. - Tiberiu Dondera Patches for the WebSubmit engine and the admin interface. Templatizing codebase. - Anna Afshar Ranking by citations, for the BibRank module. - Trond Aksel Myklebust Ranking engine, the BibRank module. Stemming and stopwords for the BibIndex module. Site access policies and external authentication methods, for the WebAccess module and its clients. Administration interfaces to WebSearch, BibIndex, BibRank, and additions to WebAccess. - Hector Sanchez Metadata output formatter, the BibFormat module. Session management, for the WebSession module. - Richard Owen Electronic mail submission system, the ElmSubmit module. - Alexandra Silva Rewriting and enhancing BibRecord XML MARC and record handling library, for the BibEdit module. - Arturo Montejo Raez Automatic text classification and keyword indexing. (upcoming) - Mikael Vik Role-based access control engine and its admin interface, the WebAccess module. Guest user sessions garbage collector, for the WebSession module. - Erik Simon , Eric Simon Alert engine, for the WebAlert module. - Roberta Faggian Rewrite of the alert and basket user interfaces, for the WebAlert and the WebBasket modules. - Julio Pernia Aznar Parts of user and session management, for the WebSession module. - Franck Grenier Parts of web design and graphics, for the WebStyle module. - Eduardo Margallo Enhancements to the indexing engine, for the BibWords module. Initial implementation of the task scheduler, for the BibSched module. - end of file - diff --git a/INSTALL b/INSTALL index c36685ae4..2d378f8ff 100644 --- a/INSTALL +++ b/INSTALL @@ -1,694 +1,694 @@ Invenio INSTALLATION ==================== About ===== This document specifies how to build, customize, and install Invenio -v1.0.0-rc0 for the first time. See RELEASE-NOTES if you are upgrading +v1.0.0 for the first time. See RELEASE-NOTES if you are upgrading from a previous Invenio release. Contents ======== 0. Prerequisites 1. Quick instructions for the impatient Invenio admin 2. Detailed instructions for the patient Invenio admin 0. Prerequisites ================ Here is the software you need to have around before you start installing Invenio: a) Unix-like operating system. The main development and production platforms for Invenio at CERN are GNU/Linux distributions Debian, Gentoo, Scientific Linux (aka RHEL), Ubuntu, but we also develop on Mac OS X. Basically any Unix system supporting the software listed below should do. If you are using Debian GNU/Linux ``Lenny'' or later, then you can install most of the below-mentioned prerequisites and recommendations by running: $ sudo aptitude install python-dev apache2-mpm-prefork \ mysql-server mysql-client python-mysqldb \ python-4suite-xml python-simplejson python-xml \ python-libxml2 python-libxslt1 gnuplot poppler-utils \ gs-common clisp gettext libapache2-mod-wsgi unzip \ python-dateutil python-rdflib \ python-gnuplot python-magic pdftk html2text giflib-tools \ pstotext netpbm You may also want to install some of the following packages, if you have them available on your concrete architecture: $ sudo aptitude install rxp python-psyco sbcl cmucl \ pylint pychecker pyflakes python-profiler python-epydoc \ libapache2-mod-xsendfile openoffice.org Moreover, you should install some Message Transfer Agent (MTA) such as Postfix so that Invenio can email notification alerts or registration information to the end users, contact moderators and reviewers of submitted documents, inform administrators about various runtime system information, etc: $ sudo aptitude install postfix After running the above-quoted aptitude command(s), you can proceed to configuring your MySQL server instance (max_allowed_packet in my.cnf, see item 0b below) and then to installing the Invenio software package in the section 1 below. If you are using another operating system, then please continue reading the rest of this prerequisites section, and please consult our wiki pages for any concrete hints for your specific operating system. b) MySQL server (may be on a remote machine), and MySQL client (must be available locally too). MySQL versions 4.1 or 5.0 are supported. Please set the variable "max_allowed_packet" in your "my.cnf" init file to at least 4M. You may perhaps also want to run your MySQL server natively in UTF-8 mode by setting "default-character-set=utf8" in various parts of your "my.cnf" file, such as in the "[mysql]" part and elsewhere; but this is not really required. c) Apache 2 server, with support for loading DSO modules, and optionally with SSL support for HTTPS-secure user authentication, and mod_xsendfile for off-loading file downloads away from Invenio processes to Apache. d) Python v2.4 or above: as well as the following Python modules: - (mandatory) MySQLdb (version >= 1.2.1_p2; see below) - (recommended) python-dateutil, for complex date processing: - (recommended) PyXML, for XML processing: - (recommended) PyRXP, for very fast XML MARC processing: - (recommended) libxml2-python, for XML/XLST processing: - (recommended) simplejson, for AJAX apps: Note that if you are using Python-2.6, you don't need to install simplejson, because the module is already included in the main Python distribution. - (recommended) Gnuplot.Py, for producing graphs: - (recommended) Snowball Stemmer, for stemming: - (recommended) py-editdist, for record merging: - (recommended) numpy, for citerank methods: - (recommended) magic, for full-text file handling: - (optional) 4suite, slower alternative to PyRXP and libxml2-python: - (optional) feedparser, for web journal creation: - (optional) Psyco, if you are running on a 32-bit OS: - (optional) RDFLib, to use RDF ontologies and thesauri: - (optional) mechanize, to run regression web test suite: - (optional) hashlib, needed only for Python-2.4 and only if you would like to use AWS connectivity: Note: MySQLdb version 1.2.1_p2 or higher is recommended. If you are using an older version of MySQLdb, you may get into problems with character encoding. e) mod_wsgi Apache module. Versions 3.x and above are recommended. Note: if you are using Python 2.4 or earlier, then you should also install the wsgiref Python module, available from: (As of Python 2.5 this module is included in standard Python distribution.) f) If you want to be able to extract references from PDF fulltext files, then you need to install pdftotext version 3 at least. g) If you want to be able to search for words in the fulltext files (i.e. to have fulltext indexing) or to stamp submitted files, then you need as well to install some of the following tools: - for Microsoft Office/OpenOffice.org document conversion: OpenOffice.org - for PDF file stamping: pdftk, pdf2ps - for PDF files: pdftotext or pstotext - for PostScript files: pstotext or ps2ascii - for DjVu creation, elaboration: DjVuLibre - to perform OCR: OCRopus (tested only with release 0.3.1) - to perform different image elaborations: ImageMagick - to generate PDF after OCR: ReportLab - to analyze images to generate PDF after OCR: netpbm h) If you have chosen to install fast XML MARC Python processors in the step d) above, then you have to install the parsers themselves: - (optional) 4suite: i) (recommended) Gnuplot, the command-line driven interactive plotting program. It is used to display download and citation history graphs on the Detailed record pages on the web interface. Note that Gnuplot must be compiled with PNG output support, that is, with the GD library. Note also that Gnuplot is not required, only recommended. j) (recommended) A Common Lisp implementation, such as CLISP, SBCL or CMUCL. It is used for the web server log analysing tool and the metadata checking program. Note that any of the three implementations CLISP, SBCL, or CMUCL will do. CMUCL produces fastest machine code, but it does not support UTF-8 yet. Pick up CLISP if you don't know what to do. Note that a Common Lisp implementation is not required, only recommended. k) GNU gettext, a set of tools that makes it possible to translate the application in multiple languages. This is available by default on many systems. Note that the configure script checks whether you have all the prerequisite software installed and that it won't let you continue unless everything is in order. It also warns you if it cannot find some optional but recommended software. 1. Quick instructions for the impatient Invenio admin ========================================================= 1a. Installation ---------------- $ cd $HOME/src/ - $ wget http://invenio-software.org/download/invenio-1.0.0-rc0.tar.gz - $ wget http://invenio-software.org/download/invenio-1.0.0-rc0.tar.gz.md5 - $ wget http://invenio-software.org/download/invenio-1.0.0-rc0.tar.gz.sig - $ md5sum -v -c invenio-1.0.0-rc0.tar.gz.md5 - $ gpg --verify invenio-1.0.0-rc0.tar.gz.sig invenio-1.0.0-rc0.tar.gz - $ tar xvfz invenio-1.0.0-rc0.tar.gz - $ cd invenio-1.0.0-rc0 + $ wget http://invenio-software.org/download/invenio-1.0.0.tar.gz + $ wget http://invenio-software.org/download/invenio-1.0.0.tar.gz.md5 + $ wget http://invenio-software.org/download/invenio-1.0.0.tar.gz.sig + $ md5sum -v -c invenio-1.0.0.tar.gz.md5 + $ gpg --verify invenio-1.0.0.tar.gz.sig invenio-1.0.0.tar.gz + $ tar xvfz invenio-1.0.0.tar.gz + $ cd invenio-1.0.0 $ ./configure $ make $ make install $ make install-mathjax-plugin ## optional $ make install-jquery-plugins ## optional $ make install-fckeditor-plugin ## optional $ make install-pdfa-helper-files ## optional 1b. Configuration ----------------- $ sudo chown -R www-data.www-data /opt/invenio $ sudo -u www-data emacs /opt/invenio/etc/invenio-local.conf $ sudo -u www-data /opt/invenio/bin/inveniocfg --update-all $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-tables $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-webstat-conf $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-apache-conf $ sudo /etc/init.d/apache2 restart $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-demo-site $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-demo-records $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-unit-tests $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-regression-tests $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-web-tests $ sudo -u www-data /opt/invenio/bin/inveniocfg --remove-demo-records $ sudo -u www-data /opt/invenio/bin/inveniocfg --drop-demo-site $ firefox http://your.site.com/help/admin/howto-run 2. Detailed instructions for the patient Invenio admin ========================================================== 2a. Installation ---------------- The Invenio uses standard GNU autoconf method to build and install its files. This means that you proceed as follows: $ cd $HOME/src/ Change to a directory where we will build the Invenio sources. (The built files will be installed into different "target" directories later.) - $ wget http://invenio-software.org/download/invenio-1.0.0-rc0.tar.gz - $ wget http://invenio-software.org/download/invenio-1.0.0-rc0.tar.gz.md5 - $ wget http://invenio-software.org/download/invenio-1.0.0-rc0.tar.gz.sig + $ wget http://invenio-software.org/download/invenio-1.0.0.tar.gz + $ wget http://invenio-software.org/download/invenio-1.0.0.tar.gz.md5 + $ wget http://invenio-software.org/download/invenio-1.0.0.tar.gz.sig Fetch Invenio source tarball from the distribution server, together with MD5 checksum and GnuPG cryptographic signature files useful for verifying the integrity of the tarball. - $ md5sum -v -c invenio-1.0.0-rc0.tar.gz.md5 + $ md5sum -v -c invenio-1.0.0.tar.gz.md5 Verify MD5 checksum. - $ gpg --verify invenio-1.0.0-rc0.tar.gz.sig invenio-1.0.0-rc0.tar.gz + $ gpg --verify invenio-1.0.0.tar.gz.sig invenio-1.0.0.tar.gz Verify GnuPG cryptographic signature. Note that you may first have to import my public key into your keyring, if you haven't done that already: $ gpg --keyserver wwwkeys.eu.pgp.net --recv-keys 0xBA5A2B67 The output of the gpg --verify command should then read: Good signature from "Tibor Simko " You can safely ignore any trusted signature certification warning that may follow after the signature has been successfully verified. - $ tar xvfz invenio-1.0.0-rc0.tar.gz + $ tar xvfz invenio-1.0.0.tar.gz Untar the distribution tarball. - $ cd invenio-1.0.0-rc0 + $ cd invenio-1.0.0 Go to the source directory. $ ./configure Configure Invenio software for building on this specific platform. You can use the following optional parameters: --prefix=/opt/invenio Optionally, specify the Invenio general installation directory (default is /opt/invenio). It will contain command-line binaries and program libraries containing the core Invenio functionality, but also store web pages, runtime log and cache information, document data files, etc. Several subdirs like `bin', `etc', `lib', or `var' will be created inside the prefix directory to this effect. Note that the prefix directory should be chosen outside of the Apache htdocs tree, since only one its subdirectory (prefix/var/www) is to be accessible directly via the Web (see below). Note that Invenio won't install to any other directory but to the prefix mentioned in this configuration line. --with-python=/opt/python/bin/python2.4 Optionally, specify a path to some specific Python binary. This is useful if you have more than one Python installation on your system. If you don't set this option, then the first Python that will be found in your PATH will be chosen for running Invenio. --with-mysql=/opt/mysql/bin/mysql Optionally, specify a path to some specific MySQL client binary. This is useful if you have more than one MySQL installation on your system. If you don't set this option, then the first MySQL client executable that will be found in your PATH will be chosen for running Invenio. --with-clisp=/opt/clisp/bin/clisp Optionally, specify a path to CLISP executable. This is useful if you have more than one CLISP installation on your system. If you don't set this option, then the first executable that will be found in your PATH will be chosen for running Invenio. --with-cmucl=/opt/cmucl/bin/lisp Optionally, specify a path to CMUCL executable. This is useful if you have more than one CMUCL installation on your system. If you don't set this option, then the first executable that will be found in your PATH will be chosen for running Invenio. --with-sbcl=/opt/sbcl/bin/sbcl Optionally, specify a path to SBCL executable. This is useful if you have more than one SBCL installation on your system. If you don't set this option, then the first executable that will be found in your PATH will be chosen for running Invenio. --with-openoffice-python Optionally, specify the path to the Python interpreter embedded with OpenOffice.org. This is normally not contained in the normal path. If you don't specify this it won't be possible to use OpenOffice.org to convert from and to Microsoft Office and OpenOffice.org documents. This configuration step is mandatory. Usually, you do this step only once. (Note that if you are building Invenio not from a released tarball, but from the Git sources, then you have to generate the configure file via autotools: $ sudo aptitude install automake1.9 autoconf $ aclocal-1.9 $ automake-1.9 -a $ autoconf after which you proceed with the usual configure command.) $ make Launch the Invenio build. Since many messages are printed during the build process, you may want to run it in a fast-scrolling terminal such as rxvt or in a detached screen session. During this step all the pages and scripts will be pre-created and customized based on the config you have edited in the previous step. Note that on systems such as FreeBSD or Mac OS X you have to use GNU make ("gmake") instead of "make". $ make install Install the web pages, scripts, utilities and everything needed for Invenio runtime into respective installation directories, as specified earlier by the configure command. Note that if you are installing Invenio for the first time, you will be asked to create symbolic link(s) from Python's site-packages system-wide directory(ies) to the installation location. This is in order to instruct Python where to find Invenio's Python files. You will be hinted as to the exact command to use based on the parameters you have used in the configure command. $ make install-mathjax-plugin ## optional This will automatically download and install in the proper place MathJax, a JavaScript library to render LaTeX formulas in the client browser. Note that in order to enable the rendering you will have to set the variable CFG_WEBSEARCH_USE_MATHJAX_FOR_FORMATS in invenio-local.conf to a suitable list of output format codes. For example: CFG_WEBSEARCH_USE_MATHJAX_FOR_FORMATS = hd,hb $ make install-jquery-plugins ## optional This will automatically download and install in the proper place jQuery and related plugins. They are used for AJAX applications such as the record editor. Note that `unzip' is needed when installing jquery plugins. $ make install-fckeditor-plugin ## optional This will automatically download and install in the proper place FCKeditor, a WYSIWYG Javascript-based editor (e.g. for the WebComment module). Note that in order to enable the editor you have to set the CFG_WEBCOMMENT_USE_FCKEDITOR to True. $ make install-pdfa-helper-files ## optional This will automatically download and install in the proper place the helper files needed to create PDF/A files out of existing PDF files. 2b. Configuration ----------------- Once the basic software installation is done, we proceed to configuring your Invenio system. $ sudo chown -R www-data.www-data /opt/invenio For the sake of simplicity, let us assume that your Invenio installation will run under the `www-data' user process identity. The above command changes ownership of installed files to www-data, so that we shall run everything under this user identity from now on. For production purposes, you would typically enable Apache server to read all files from the installation place but to write only to the `var' subdirectory of your installation place. You could achieve this by configuring Unix directory group permissions, for example. $ sudo -u www-data emacs /opt/invenio/etc/invenio-local.conf Customize your Invenio installation. Please read the 'invenio.conf' file located in the same directory that contains the vanilla default configuration parameters of your Invenio installation. If you want to customize some of these parameters, you should create a file named 'invenio-local.conf' in the same directory where 'invenio.conf' lives and you should write there only the customizations that you want to be different from the vanilla defaults. Here is a realistic, minimalist, yet production-ready example of what you would typically put there: $ cat /opt/invenio/etc/invenio-local.conf [Invenio] CFG_SITE_NAME = John Doe's Document Server CFG_SITE_NAME_INTL_fr = Serveur des Documents de John Doe CFG_SITE_URL = http://your.site.com CFG_SITE_SECURE_URL = https://your.site.com CFG_SITE_ADMIN_EMAIL = john.doe@your.site.com CFG_SITE_SUPPORT_EMAIL = john.doe@your.site.com CFG_WEBALERT_ALERT_ENGINE_EMAIL = john.doe@your.site.com CFG_WEBCOMMENT_ALERT_ENGINE_EMAIL = john.doe@your.site.com CFG_WEBCOMMENT_DEFAULT_MODERATOR = john.doe@your.site.com CFG_DATABASE_HOST = localhost CFG_DATABASE_NAME = invenio CFG_DATABASE_USER = invenio CFG_DATABASE_PASS = my123p$ss You should override at least the parameters mentioned above in order to define some very essential runtime parameters such as the name of your document server (CFG_SITE_NAME and CFG_SITE_NAME_INTL_*), the visible URL of your document server (CFG_SITE_URL and CFG_SITE_SECURE_URL), the email address of the local Invenio administrator, comment moderator, and alert engine (CFG_SITE_SUPPORT_EMAIL, CFG_SITE_ADMIN_EMAIL, etc), and last but not least your database credentials (CFG_DATABASE_*). The Invenio system will then read both the default invenio.conf file and your customized invenio-local.conf file and it will override any default options with the ones you have specifield in your local file. This cascading of configuration parameters will ease your future upgrades. $ sudo -u www-data /opt/invenio/bin/inveniocfg --update-all Make the rest of the Invenio system aware of your invenio-local.conf changes. This step is mandatory each time you edit your conf files. $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-tables If you are installing Invenio for the first time, you have to create database tables. Note that this step checks for potential problems such as the database connection rights and may ask you to perform some more administrative steps in case it detects a problem. Notably, it may ask you to set up database access permissions, based on your configure values. If you are installing Invenio for the first time, you have to create a dedicated database on your MySQL server that the Invenio can use for its purposes. Please contact your MySQL administrator and ask him to execute the commands this step proposes you. At this point you should now have successfully completed the "make install" process. We continue by setting up the Apache web server. $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-webstat-conf Load the configuration file of webstat module. It will create the tables in the database for register customevents, such as basket hits. $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-apache-conf Running this command will generate Apache virtual host configurations matching your installation. You will be instructed to check created files (usually they are located under /opt/invenio/etc/apache/) and edit your httpd.conf to activate Invenio virtual hosts. If you are using Debian GNU/Linux ``Lenny'' or later, then you can do the following to create your SSL certificate and to activate your Invenio vhosts: ## make SSL certificate: $ sudo aptitude install ssl-cert $ sudo mkdir /etc/apache2/ssl $ sudo /usr/sbin/make-ssl-cert /usr/share/ssl-cert/ssleay.cnf \ /etc/apache2/ssl/apache.pem ## add Invenio web sites: $ sudo ln -s /opt/invenio/etc/apache/invenio-apache-vhost.conf \ /etc/apache2/sites-available/invenio $ sudo ln -s /opt/invenio/etc/apache/invenio-apache-vhost-ssl.conf \ /etc/apache2/sites-available/invenio-ssl ## disable Debian's default web site: $ sudo /usr/sbin/a2dissite default ## enable Invenio web sites: $ sudo /usr/sbin/a2ensite invenio $ sudo /usr/sbin/a2ensite invenio-ssl ## enable SSL module: $ sudo /usr/sbin/a2enmod ssl ## if you are using xsendfile module, enable it too: $ sudo /usr/sbin/a2enmod xsendfile If you are using another operating system, you should do the equivalent, for example edit your system-wide httpd.conf and put the following include statements: Include /opt/invenio/etc/apache/invenio-apache-vhost.conf Include /opt/invenio/etc/apache/invenio-apache-vhost-ssl.conf Note that you may need to adapt generated vhost file snippets to match your concrete operating system specifics. For example, the generated configuration snippet will preload Invenio WSGI daemon application upon Apache start up for faster site response. The generated configuration assumes that you are using mod_wsgi version 3 or later. If you are using the old legacy mod_wsgi version 2, then you would need to comment out the WSGIImportScript directive from the generated snippet, or else move the WSGI daemon setup to the top level, outside of the VirtualHost section. Note also that you may want to tweak the generated Apache vhost snippet for performance reasons, especially with respect to WSGIDaemonProcess parameters. For example, you can increase the number of processes from the default value `processes=5' if you have lots of RAM and if many concurrent users may access your site in parallel. However, note that you must use `threads=1' there, because Invenio WSGI daemon processes are not fully thread safe yet. This may change in the future. $ sudo /etc/init.d/apache2 restart Please ask your webserver administrator to restart the Apache server after the above "httpd.conf" changes. $ sudo -u www-data /opt/invenio/bin/inveniocfg --create-demo-site This step is recommended to test your local Invenio installation. It should give you our "Atlantis Institute of Science" demo installation, exactly as you see it at . $ sudo -u www-data /opt/invenio/bin/inveniocfg --load-demo-records Optionally, load some demo records to be able to test indexing and searching of your local Invenio demo installation. $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-unit-tests Optionally, you can run the unit test suite to verify the unit behaviour of your local Invenio installation. Note that this command should be run only after you have installed the whole system via `make install'. $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-regression-tests Optionally, you can run the full regression test suite to verify the functional behaviour of your local Invenio installation. Note that this command requires to have created the demo site and loaded the demo records. Note also that running the regression test suite may alter the database content with junk data, so that rebuilding the demo site is strongly recommended afterwards. $ sudo -u www-data /opt/invenio/bin/inveniocfg --run-web-tests Optionally, you can run additional automated web tests running in a real browser. This requires to have Firefox with the Selenium IDE extension installed. $ sudo -u www-data /opt/invenio/bin/inveniocfg --remove-demo-records Optionally, remove the demo records loaded in the previous step, but keeping otherwise the demo collection, submission, format, and other configurations that you may reuse and modify for your own production purposes. $ sudo -u www-data /opt/invenio/bin/inveniocfg --drop-demo-site Optionally, drop also all the demo configuration so that you'll end up with a completely blank Invenio system. However, you may want to find it more practical not to drop the demo site configuration but to start customizing from there. $ firefox http://your.site.com/help/admin/howto-run In order to start using your Invenio installation, you can start indexing, formatting and other daemons as indicated in the "HOWTO Run" guide on the above URL. You can also use the Admin Area web interfaces to perform further runtime configurations such as the definition of data collections, document types, document formats, word indexes, etc. $ sudo ln -s /opt/invenio/etc/bash_completion.d/inveniocfg \ /etc/bash_completion.d/inveniocfg Optionally, if you are using Bash shell completion, then you may want to create the above symlink in order to configure completion for the inveniocfg command. Good luck, and thanks for choosing Invenio. - Invenio Development Team diff --git a/Makefile.am b/Makefile.am index 4b60b5b83..3ee9fa382 100644 --- a/Makefile.am +++ b/Makefile.am @@ -1,514 +1,517 @@ ## This file is part of CDS Invenio. ## Copyright (C) 2002, 2003, 2004, 2005, 2006, 2007, 2008, 2011, 2012 CERN. ## ## Invenio is free software; you can redistribute it and/or ## modify it under the terms of the GNU General Public License as ## published by the Free Software Foundation; either version 2 of the ## License, or (at your option) any later version. ## ## Invenio is distributed in the hope that it will be useful, but ## WITHOUT ANY WARRANTY; without even the implied warranty of ## MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU ## General Public License for more details. ## ## You should have received a copy of the GNU General Public License ## along with Invenio; if not, write to the Free Software Foundation, Inc., ## 59 Temple Place, Suite 330, Boston, MA 02111-1307, USA. confignicedir = $(sysconfdir)/build confignice_SCRIPTS=config.nice SUBDIRS = po config modules EXTRA_DIST = UNINSTALL THANKS RELEASE-NOTES configure-tests.py config.nice.in \ config.rpath # current MathJax version and packages MJV = 1.0.1a MATHJAX = MathJax-v$(MJV).zip # current FCKeditor version FCKV = 2.6.6 FCKEDITOR = FCKeditor_$(FCKV).zip # git-version-get stuff: BUILT_SOURCES = $(top_srcdir)/.version $(top_srcdir)/.version: echo $(VERSION) > $@-t && mv $@-t $@ dist-hook: echo $(VERSION) > $(distdir)/.tarball-version check-custom-templates: $(PYTHON) $(top_srcdir)/modules/webstyle/lib/template.py --check-custom-templates $(top_srcdir) kwalitee-check: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --stats $(top_srcdir) kwalitee-check-errors-only: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --check-errors $(top_srcdir) kwalitee-check-variables: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --check-variables $(top_srcdir) kwalitee-check-indentation: @$(PYTHON) $(top_srcdir)/modules/miscutil/lib/kwalitee.py --check-indentation $(top_srcdir) kwalitee-check-sql-queries: @echo "* Listing potentially dangerous SQL queries:" @echo "** SQL SELECT queries without explicit column list:" @find $(top_srcdir) -name '*.py' -exec grep -HEin 'SELECT \* FROM' {} \; 2> /dev/null @echo "** SQL INSERT queries without explicit column list:" @find $(top_srcdir) -name '*.py' -exec grep -HEin 'INSERT INTO ([[:alnum:]]|_)+[[:space:]]*VALUES' {} \; 2> /dev/null @find $(top_srcdir) -name '*.py' -exec grep -HEin 'INSERT INTO ([[:alnum:]]|_)+[[:space:]]*$$' {} \; 2> /dev/null @echo "** SQL queries using charset-ignorant escape_string():" @find $(top_srcdir) -name '*.py' -exec grep -HEin 'escape_string' {} \; 2> /dev/null @echo "** SQL queries using literal '%s':" @find $(top_srcdir) -name '*.py' -exec grep -HEin "run_sql.*'%[dfis]'" {} \; 2> /dev/null @find $(top_srcdir) -name '*.py' -exec grep -HEin 'run_sql.*"%[dfis]"' {} \; 2> /dev/null @echo "** SQL queries with potentially unescaped arguments:" @find $(top_srcdir) -name '*.py' -exec grep -HEin 'run_sql.* % ' {} \; 2> /dev/null @echo "* Done." etags: \rm -f $(top_srcdir)/TAGS (cd $(top_srcdir) && find $(top_srcdir) -name "*.py" -print | xargs etags) install-data-local: for d in / /cache /log /tmp /data /run ; do \ mkdir -p $(localstatedir)$$d ; \ done @echo "************************************************************" @echo "** Invenio software has been successfully installed! **" @echo "** **" @echo "** You may proceed to customizing your installation now. **" @echo "************************************************************" install-mathjax-plugin: @echo "***********************************************************" @echo "** Installing MathJax plugin, please wait... **" @echo "***********************************************************" rm -rf /tmp/invenio-mathjax-plugin mkdir /tmp/invenio-mathjax-plugin (cd /tmp/invenio-mathjax-plugin && \ wget 'http://www.mathjax.org/dl/$(MATHJAX)' && \ unzip -q -u -d ${prefix}/var/www $(MATHJAX)) rm -fr /tmp/invenio-mathjax-plugin @echo "* Installing Invenio-specific MathJax config..." (cd $(top_srcdir)/modules/webstyle/etc && make install) @echo "************************************************************" @echo "** The MathJax plugin was successfully installed. **" @echo "** Please do not forget to properly set the option **" @echo "** CFG_WEBSEARCH_USE_MATHJAX_FOR_FORMATS in invenio.conf. **" @echo "************************************************************" uninstall-mathjax-plugin: @rm -rvf ${prefix}/var/www/MathJax @echo "***********************************************************" @echo "** The MathJax plugin was successfully uninstalled. **" @echo "***********************************************************" install-jscalendar-plugin: @echo "***********************************************************" @echo "** Installing jsCalendar plugin, please wait... **" @echo "***********************************************************" rm -rf /tmp/invenio-jscalendar-plugin mkdir /tmp/invenio-jscalendar-plugin (cd /tmp/invenio-jscalendar-plugin && \ wget 'http://www.dynarch.com/static/jscalendar-1.0.zip' && \ unzip -u jscalendar-1.0.zip && \ mkdir -p ${prefix}/var/www/jsCalendar && \ cp jscalendar-1.0/img.gif ${prefix}/var/www/jsCalendar/jsCalendar.gif && \ cp jscalendar-1.0/calendar.js ${prefix}/var/www/jsCalendar/ && \ cp jscalendar-1.0/calendar-setup.js ${prefix}/var/www/jsCalendar/ && \ cp jscalendar-1.0/lang/calendar-en.js ${prefix}/var/www/jsCalendar/ && \ cp jscalendar-1.0/calendar-blue.css ${prefix}/var/www/jsCalendar/) rm -fr /tmp/invenio-jscalendar-plugin @echo "***********************************************************" @echo "** The jsCalendar plugin was successfully installed. **" @echo "***********************************************************" uninstall-jscalendar-plugin: @rm -rvf ${prefix}/var/www/jsCalendar @echo "***********************************************************" @echo "** The jsCalendar plugin was successfully uninstalled. **" @echo "***********************************************************" install-jquery-plugins: install-jquery-plugins @echo "***********************************************************" @echo "** Installing various jQuery plugins, please wait... **" @echo "***********************************************************" mkdir -p ${prefix}/var/www/js (cd ${prefix}/var/www/js && \ wget http://jqueryjs.googlecode.com/files/jquery-1.3.1.min.js && \ mv jquery-1.3.1.min.js jquery.min.js && \ wget http://jquery-ui.googlecode.com/svn/tags/latest/ui/minified/jquery.effects.core.min.js && \ wget http://jquery-ui.googlecode.com/svn/tags/latest/ui/minified/jquery.effects.highlight.min.js && \ wget http://jquery-ui.googlecode.com/svn/tags/1.7.3/ui/minified/ui.slider.min.js && \ wget http://jquery-ui.googlecode.com/svn/tags/1.7.3/ui/minified/ui.sortable.min.js && \ wget http://www.appelsiini.net/download/jquery.jeditable.mini.js && \ wget https://raw.github.com/malsup/form/master/jquery.form.js --no-check-certificate && \ wget http://jquery-multifile-plugin.googlecode.com/svn/trunk/jquery.MultiFile.pack.js && \ wget https://raw.github.com/akaihola/jquery-autogrow/master/jquery.autogrow.js --no-check-certificate && \ wget http://autobahn.tablesorter.com/jquery.tablesorter.zip && \ wget http://www.uploadify.com/wp-content/uploads/uploadify-v2.1.4.zip -O uploadify.zip && \ unzip jquery.tablesorter.zip && \ rm jquery.tablesorter.zip && \ unzip -u uploadify.zip -d uploadify && \ mv uploadify/swfobject.js ./ && \ mv uploadify/cancel.png uploadify/uploadify.css uploadify/uploadify.allglyphs.swf uploadify/uploadify.fla uploadify/uploadify.swf ../img/ && \ mv uploadify/jquery.uploadify.v2.1.4.min.js ./jquery.uploadify.min.js && \ rm uploadify.zip && rm -r uploadify && \ wget --no-check-certificate https://github.com/douglascrockford/JSON-js/raw/master/json2.js && \ wget http://jquery-ui.googlecode.com/svn/tags/1.7.3/ui/minified/ui.datepicker.min.js && \ wget -O jquery.hotkeys.min.js http://js-hotkeys.googlecode.com/files/jquery.hotkeys-0.7.8-packed.js && \ wget http://jquery.bassistance.de/treeview/jquery.treeview.zip && \ unzip jquery.treeview.zip -d jquery-treeview && \ rm jquery.treeview.zip && \ wget http://invenio-software.org/download/jquery/v1.5/js/jquery.ajaxPager.js && \ wget http://jqueryui.com/download/jquery-ui-1.7.3.custom.zip && \ unzip jquery-ui-1.7.3.custom.zip development-bundle/ui/ui.core.js && \ mv development-bundle/ui/ui.core.js ui.core.js && \ rm -rf development-bundle && \ rm jquery-ui-1.7.3.custom.zip && \ mkdir -p ${prefix}/var/www/img && \ cd ${prefix}/var/www/img && \ wget -r -np -nH --cut-dirs=4 -A "png,css" -P jquery-ui/themes http://jquery-ui.googlecode.com/svn/tags/1.7.3/themes/base/ && \ wget http://jquery-ui.googlecode.com/svn/tags/1.7.3/themes/redmond/jquery-ui.css && \ wget http://jquery-ui.googlecode.com/svn/tags/1.7.3/demos/images/calendar.gif && \ wget -r -np -nH --cut-dirs=5 -A "png" http://jquery-ui.googlecode.com/svn/tags/1.7.3/themes/redmond/images/) @echo "***********************************************************" @echo "** The jQuery plugins were successfully installed. **" @echo "***********************************************************" uninstall-jquery-plugins: (cd ${prefix}/var/www/js && \ rm -f jquery.min.js && \ rm -f jquery.effects.core.min.js && \ rm -f jquery.effects.highlight.min.js && \ rm -f jquery.MultiFile.pack.js && \ rm -f jquery.jeditable.mini.js && \ rm -f jquery.tablesorter.js && \ rm -f jquery.tablesorter.pager.js && \ rm -f ui.datepicker.min.js && \ rm -f jquery.autogrow.js && \ rm -f json2.js && \ rm -f jquery.uploadify.min.js && \ rm -f jquery.ui.slider.min.js && \ rm -f jquery.ui.sortable.min.js && \ rm -rf tablesorter && \ rm -f jquery.hotkeys.min.js && \ rm -rf jquery-treeview && \ rm -f jquery.ajaxPager.js && \ rm -f jquery.form.js && \ rm -f ui.core.js) && \ (cd ${prefix}/var/www/img && \ rm -f cancel.png uploadify.css uploadify.swf uploadify.allglyphs.swf uploadify.fla) @echo "***********************************************************" @echo "** The jquery plugins were successfully uninstalled. **" @echo "***********************************************************" install-ckeditor-plugin: install-fckeditor-plugin install-fckeditor-plugin: @echo "***********************************************************" @echo "** Installing FCKeditor plugin, please wait... **" @echo "***********************************************************" rm -rf ${prefix}/lib/python/invenio/fckeditor/ rm -rf /tmp/invenio-fckeditor-plugin mkdir /tmp/invenio-fckeditor-plugin (cd /tmp/invenio-fckeditor-plugin && \ wget 'http://downloads.sourceforge.net/fckeditor/$(FCKEDITOR)' && \ unzip -u -d ${prefix}/var/www $(FCKEDITOR)) && \ mkdir -p ${prefix}/lib/python/invenio/fckeditor/editor/filemanager/connectors/py && \ mv -f ${prefix}/var/www/fckeditor/fckeditor.py ${prefix}/lib/python/invenio/fckeditor/ && \ mv -f ${prefix}/var/www/fckeditor/editor/filemanager/connectors/py/*.py ${prefix}/lib/python/invenio/fckeditor/editor/filemanager/connectors/py/ && \ rm -f ${prefix}/var/www/fckeditor/editor/filemanager/connectors/py/upload.py && \ rm -f ${prefix}/var/www/fckeditor/editor/filemanager/connectors/py/zope.py && \ find ${prefix}/lib/python/invenio/fckeditor -type d -exec touch {}/__init__.py \; && \ find ${prefix}/var/www/fckeditor/ -depth -name '_*' -exec rm -rf {} \; && \ rm -r ${prefix}/var/www/fckeditor/editor/filemanager/connectors && \ find ${prefix}/var/www/fckeditor/fckeditor* -maxdepth 0 ! -name "fckeditor.js" -exec rm -r {} \; && \ rm -fr /tmp/invenio-fckeditor-plugin sed -i "s/if (FCKBrowserInfo\.IsSafari){FCKTools\.AddEventListener(FCK\.EditorDocument,'paste'/if (FCKBrowserInfo.IsSafari \&\& false){FCKTools.AddEventListener(FCK.EditorDocument,'paste'/" ${prefix}/var/www/fckeditor/editor/js/fckeditorcode_gecko.js # Fix issue described at , affecting v2.6.5, 2.6.6 @echo "* Installing Invenio-specific FCKeditor config..." (cd $(top_srcdir)/modules/webstyle/etc && make install) @echo "***********************************************************" @echo "** The FCKeditor plugin was successfully installed. **" @echo "** Please do not forget to properly set the option **" @echo "** CFG_WEBCOMMENT_USE_RICH_TEXT_EDITOR in invenio.conf. **" @echo "***********************************************************" uninstall-fckeditor-plugin: @rm -rvf ${prefix}/var/www/fckeditor @rm -rvf ${prefix}/lib/python/invenio/fckeditor @echo "***********************************************************" @echo "** The FCKeditor plugin was successfully uninstalled. **" @echo "***********************************************************" install-pdfa-helper-files: @echo "***********************************************************" @echo "** Installing PDF/A helper files, please wait... **" @echo "***********************************************************" wget 'http://invenio-software.org/download/invenio-demo-site-files/ISOCoatedsb.icc' -O ${prefix}/etc/websubmit/file_converter_templates/ISOCoatedsb.icc @echo "***********************************************************" @echo "** The PDF/A helper files were successfully installed. **" @echo "***********************************************************" uninstall-pdfa-helper-files: rm -f ${prefix}/etc/websubmit/file_converter_templates/ISOCoatedsb.icc @echo "***********************************************************" @echo "** The PDF/A helper files were successfully uninstalled. **" @echo "***********************************************************" update-v0.3.0-tables update-v0.3.1-tables: echo "ALTER TABLE idxINDEXNAME CHANGE id_idxINDEX id_idxINDEX mediumint(9) unsigned NOT NULL FIRST;" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkMETHODNAME CHANGE id_rnkMETHOD id_rnkMETHOD mediumint(9) unsigned NOT NULL FIRST;" | ${prefix}/bin/dbexec echo "ALTER TABLE collectionname CHANGE id_collection id_collection mediumint(9) unsigned NOT NULL FIRST;" | ${prefix}/bin/dbexec echo "ALTER TABLE formatname CHANGE id_format id_format mediumint(9) unsigned NOT NULL FIRST;" | ${prefix}/bin/dbexec echo "ALTER TABLE fieldname CHANGE id_field id_field mediumint(9) unsigned NOT NULL FIRST;" | ${prefix}/bin/dbexec echo "INSERT INTO accACTION (id,name,description,allowedkeywords,optional) VALUES (NULL,'runbibrank','run BibRank','','no');" | ${prefix}/bin/dbexec echo "INSERT INTO accACTION (id,name,description,allowedkeywords,optional) VALUES (NULL,'cfgbibrank','configure BibRank','','no');" | ${prefix}/bin/dbexec update-v0.3.2-tables: echo "ALTER TABLE sbmCOLLECTION_sbmDOCTYPE CHANGE id_son id_son char(10) NOT NULL default '0';" | ${prefix}/bin/dbexec update-v0.3.3-tables: ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "ALTER TABLE flxLINKTYPEPARAMS CHANGE pname pname varchar(78) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkMETHOD DROP star_category_ranges;" | ${prefix}/bin/dbexec echo "DROP TABLE rnkSET;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK CHANGE arguments arguments LONGTEXT;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK CHANGE status status varchar(50);" | ${prefix}/bin/dbexec update-v0.5.0-tables: ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "ALTER TABLE session ADD INDEX uid (uid);" | ${prefix}/bin/dbexec echo "UPDATE idxINDEXNAME SET ln='cs' WHERE ln='cz';" | ${prefix}/bin/dbexec echo "UPDATE rnkMETHODNAME SET ln='cs' WHERE ln='cz';" | ${prefix}/bin/dbexec echo "UPDATE collectionname SET ln='cs' WHERE ln='cz';" | ${prefix}/bin/dbexec echo "UPDATE collection_portalbox SET ln='cs' WHERE ln='cz';" | ${prefix}/bin/dbexec echo "UPDATE formatname SET ln='cs' WHERE ln='cz';" | ${prefix}/bin/dbexec echo "UPDATE fieldname SET ln='cs' WHERE ln='cz';" | ${prefix}/bin/dbexec echo "UPDATE idxINDEXNAME SET ln='sv' WHERE ln='se';" | ${prefix}/bin/dbexec echo "UPDATE rnkMETHODNAME SET ln='sv' WHERE ln='se';" | ${prefix}/bin/dbexec echo "UPDATE collectionname SET ln='sv' WHERE ln='se';" | ${prefix}/bin/dbexec echo "UPDATE collection_portalbox SET ln='sv' WHERE ln='se';" | ${prefix}/bin/dbexec echo "UPDATE formatname SET ln='sv' WHERE ln='se';" | ${prefix}/bin/dbexec echo "UPDATE fieldname SET ln='sv' WHERE ln='se';" | ${prefix}/bin/dbexec update-v0.7.1-tables: echo "DROP TABLE oaiHARVEST;" | ${prefix}/bin/dbexec ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "INSERT INTO accACTION (id,name,description,allowedkeywords,optional) VALUES (NULL,'cfgbibharvest','configure BibHarvest','','no');" | ${prefix}/bin/dbexec echo "INSERT INTO accACTION (id,name,description,allowedkeywords,optional) VALUES (NULL,'runoaiharvest','run BibHarvest oaiharvest','','no');" | ${prefix}/bin/dbexec echo "INSERT INTO accACTION (id,name,description,allowedkeywords,optional) VALUES (NULL,'cfgwebcomment','configure WebComment','','no');" | ${prefix}/bin/dbexec echo "INSERT INTO accACTION (id,name,description,allowedkeywords,optional) VALUES (NULL,'runoaiarchive','run BibHarvest oaiarchive','','no');" | ${prefix}/bin/dbexec echo "INSERT INTO accACTION (id,name,description,allowedkeywords,optional) VALUES (NULL,'runbibedit','run BibEdit','','no');" | ${prefix}/bin/dbexec echo "ALTER TABLE user ADD nickname varchar(255) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE user ADD last_login datetime NOT NULL default '0000-00-00 00:00:00';" | ${prefix}/bin/dbexec echo "ALTER TABLE user ADD INDEX nickname (nickname);" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmFIELD CHANGE subname subname varchar(13) default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE user_query_basket CHANGE alert_name alert_name varchar(30) NOT NULL default '';" | ${prefix}/bin/dbexec echo "TRUNCATE TABLE session;" | ${prefix}/bin/dbexec @echo "**********************************************************" @echo "** Do not forget to run the basket migration now: **" @echo "** @PYTHON@ modules/webbasket/lib/webbasket_migration_kit.py " @echo "** Please see the RELEASE-NOTES for details. **" @echo "**********************************************************" @echo "INSERT INTO oaiARCHIVE (id, setName, setSpec, setDescription, setDefinition, setRecList) SELECT id, setName, setSpec, CONCAT_WS('', setDescription), setDefinition, setRecList FROM oaiSET;" update-v0.90.0-tables: ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "ALTER TABLE format ADD COLUMN (description varchar(255) default '');" | ${prefix}/bin/dbexec echo "ALTER TABLE format ADD COLUMN (content_type varchar(255) default '');" | ${prefix}/bin/dbexec update-v0.90.1-tables: ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "ALTER TABLE schTASK ADD INDEX status (status);" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK ADD INDEX runtime (runtime);" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmCATEGORIES ADD COLUMN score TINYINT UNSIGNED NOT NULL DEFAULT 0;" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmCATEGORIES ADD PRIMARY KEY (doctype, sname);" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmCATEGORIES ADD KEY doctype (doctype);" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiHARVEST ADD COLUMN setspecs TEXT NOT NULL DEFAULT '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE setDescription setDescription text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE p1 p1 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE f1 f1 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE m1 m1 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE p2 p2 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE f2 f2 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE m2 m2 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE p3 p3 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE f3 f3 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiARCHIVE CHANGE m3 m3 text NOT NULL default '';" | ${prefix}/bin/dbexec echo "UPDATE bibdoc SET status=0 WHERE status='';" | ${prefix}/bin/dbexec echo "UPDATE bibdoc SET status=1 WHERE status='deleted';" | ${prefix}/bin/dbexec echo "ALTER TABLE fmtKNOWLEDGEBASES add COLUMN kbtype char default NULL;" | ${prefix}/bin/dbexec update-v0.92.0-tables: echo "UPDATE bibdoc SET status=0 WHERE status='';" | ${prefix}/bin/dbexec echo "UPDATE bibdoc SET status=1 WHERE status='deleted';" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK CHANGE arguments arguments mediumblob;" | ${prefix}/bin/dbexec echo "UPDATE user SET note=1 WHERE nickname='admin' AND note IS NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE usergroup CHANGE name name varchar(255) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE usergroup ADD login_method varchar(255) NOT NULL default 'INTERNAL';" | ${prefix}/bin/dbexec echo "ALTER TABLE usergroup ADD UNIQUE KEY login_method_name (login_method(70), name);" | ${prefix}/bin/dbexec echo "ALTER TABLE user CHANGE settings settings blob default NULL;" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Get_Recid', 'This function gets the recid for a document with a given report-number (as stored in the global variable rn).');" | ${prefix}/bin/dbexec update-v0.92.1-tables: echo "DROP TABLE rnkCITATIONDATA;" | ${prefix}/bin/dbexec ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "UPDATE bibdoc SET status='DELETED' WHERE status='1';" | ${prefix}/bin/dbexec echo "UPDATE bibdoc SET status='' WHERE status='0';" | ${prefix}/bin/dbexec echo "ALTER TABLE bibrec ADD KEY creation_date (creation_date);" | ${prefix}/bin/dbexec echo "ALTER TABLE bibrec ADD KEY modification_date (modification_date);" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc ADD KEY creation_date (creation_date);" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc ADD KEY modification_date (modification_date);" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc ADD KEY docname (docname);" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiHARVEST CHANGE postprocess postprocess varchar(20) NOT NULL default 'h';" | ${prefix}/bin/dbexec echo "ALTER TABLE oaiHARVEST ADD COLUMN bibfilterprogram varchar(255) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE idxINDEXNAME CHANGE ln ln char(5) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE idxINDEX ADD COLUMN stemming_language VARCHAR(10) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkMETHODNAME CHANGE ln ln char(5) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkDOWNLOADS CHANGE id_bibdoc id_bibdoc mediumint(9) unsigned default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkDOWNLOADS CHANGE file_format file_format varchar(10) NULL default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE collectionname CHANGE ln ln char(5) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE collection_portalbox CHANGE ln ln char(5) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE format ADD COLUMN visibility TINYINT NOT NULL default 1;" | ${prefix}/bin/dbexec echo "ALTER TABLE formatname CHANGE ln ln char(5) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE fieldname CHANGE ln ln char(5) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE accROLE ADD COLUMN firerole_def_ser blob NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE accROLE ADD COLUMN firerole_def_src text NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE user_accROLE ADD COLUMN expiration datetime NOT NULL default '9999-12-31 23:59:59';" | ${prefix}/bin/dbexec echo "ALTER TABLE user DROP INDEX id, ADD PRIMARY KEY id (id);" | ${prefix}/bin/dbexec echo -e 'from invenio.dbquery import run_sql;\ map(lambda index_id: run_sql("ALTER TABLE idxPHRASE%02dF CHANGE term term TEXT NULL DEFAULT NULL, DROP INDEX term, ADD INDEX term (term (50))" % index_id[0]), run_sql("select id from idxINDEX"))' | $(PYTHON) echo "INSERT INTO rnkCITATIONDATA VALUES (1,'citationdict','','');" | ${prefix}/bin/dbexec echo "INSERT INTO rnkCITATIONDATA VALUES (2,'reversedict','','');" | ${prefix}/bin/dbexec echo "INSERT INTO rnkCITATIONDATA VALUES (3,'selfcitdict','','');" | ${prefix}/bin/dbexec update-v0.99.0-tables: ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "ALTER TABLE bibdoc ADD COLUMN more_info mediumblob NULL default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK ADD COLUMN priority tinyint(4) NOT NULL default 0;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK ADD KEY priority (priority);" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA DROP PRIMARY KEY;" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA ADD PRIMARY KEY (id);" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA CHANGE id id mediumint(8) unsigned NOT NULL auto_increment;" | ${prefix}/bin/dbexec echo "ALTER TABLE rnkCITATIONDATA ADD UNIQUE KEY object_name (object_name);" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmPARAMETERS CHANGE value value text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmAPPROVAL ADD note text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE hstDOCUMENT CHANGE docsize docsize bigint(15) unsigned NOT NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtACTIONHISTORY CHANGE client_host client_host int(10) unsigned default NULL;" | ${prefix}/bin/dbexec update-v0.99.1-tables: @echo "Nothing to do; table structure did not change between v0.99.1 and v0.99.2." update-v0.99.2-tables: @echo "Nothing to do; table structure did not change between v0.99.2 and v0.99.3." update-v0.99.3-tables: @echo "Nothing to do; table structure did not change between v0.99.3 and v0.99.4." update-v0.99.4-tables: @echo "Nothing to do; table structure did not change between v0.99.4 and v0.99.5." update-v0.99.5-tables: # from v0.99.5 to v1.0.0-rc0 echo "RENAME TABLE oaiARCHIVE TO oaiREPOSITORY;" | ${prefix}/bin/dbexec ${prefix}/bin/dbexec < $(top_srcdir)/modules/miscutil/sql/tabcreate.sql echo "INSERT INTO knwKB (id,name,description,kbtype) SELECT id,name,description,'' FROM fmtKNOWLEDGEBASES;" | ${prefix}/bin/dbexec echo "INSERT INTO knwKBRVAL (id,m_key,m_value,id_knwKB) SELECT id,m_key,m_value,id_fmtKNOWLEDGEBASES FROM fmtKNOWLEDGEBASEMAPPINGS;" | ${prefix}/bin/dbexec echo "ALTER TABLE sbmPARAMETERS CHANGE name name varchar(40) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc CHANGE docname docname varchar(250) COLLATE utf8_bin NOT NULL default 'file';" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc CHANGE status status text NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE bibdoc ADD COLUMN text_extraction_date datetime NOT NULL default '0000-00-00';" | ${prefix}/bin/dbexec echo "ALTER TABLE collection DROP COLUMN restricted;" | ${prefix}/bin/dbexec echo "ALTER TABLE schTASK CHANGE host host varchar(255) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE hstTASK CHANGE host host varchar(255) NOT NULL default '';" | ${prefix}/bin/dbexec echo "ALTER TABLE bib85x DROP INDEX kv, ADD INDEX kv (value(100));" | ${prefix}/bin/dbexec echo "UPDATE clsMETHOD SET location='http://invenio-software.org/download/invenio-demo-site-files/HEP.rdf' WHERE name='HEP' AND location='';" | ${prefix}/bin/dbexec echo "UPDATE clsMETHOD SET location='http://invenio-software.org/download/invenio-demo-site-files/NASA-subjects.rdf' WHERE name='NASA-subjects' AND location='';" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET name='runoairepository', description='run oairepositoryupdater task' WHERE name='runoaiarchive';" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET name='cfgoaiharvest', description='configure OAI Harvest' WHERE name='cfgbibharvest';" | ${prefix}/bin/dbexec echo "ALTER TABLE accARGUMENT CHANGE value value varchar(255);" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET allowedkeywords='doctype,act,categ' WHERE name='submit';" | ${prefix}/bin/dbexec echo "INSERT INTO accARGUMENT(keyword,value) VALUES ('categ','*');" | ${prefix}/bin/dbexec echo "INSERT INTO accROLE_accACTION_accARGUMENT(id_accROLE,id_accACTION,id_accARGUMENT,argumentlistid) SELECT DISTINCT raa.id_accROLE,raa.id_accACTION,accARGUMENT.id,raa.argumentlistid FROM accROLE_accACTION_accARGUMENT as raa JOIN accACTION on id_accACTION=accACTION.id,accARGUMENT WHERE accACTION.name='submit' and accARGUMENT.keyword='categ' and accARGUMENT.value='*';" | ${prefix}/bin/dbexec echo "UPDATE accACTION SET allowedkeywords='name,with_editor_rights' WHERE name='cfgwebjournal';" | ${prefix}/bin/dbexec echo "INSERT INTO accARGUMENT(keyword,value) VALUES ('with_editor_rights','yes');" | ${prefix}/bin/dbexec echo "INSERT INTO accROLE_accACTION_accARGUMENT(id_accROLE,id_accACTION,id_accARGUMENT,argumentlistid) SELECT DISTINCT raa.id_accROLE,raa.id_accACTION,accARGUMENT.id,raa.argumentlistid FROM accROLE_accACTION_accARGUMENT as raa JOIN accACTION on id_accACTION=accACTION.id,accARGUMENT WHERE accACTION.name='cfgwebjournal' and accARGUMENT.keyword='with_editor_rights' and accARGUMENT.value='yes';" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC CHANGE id id int(15) unsigned NOT NULL auto_increment;" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC ADD external_id int(15) NOT NULL default '0';" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC ADD collection_id int(15) unsigned NOT NULL default '0';" | ${prefix}/bin/dbexec echo "ALTER TABLE bskEXTREC ADD original_url text;" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD status char(2) NOT NULL default 'ok';" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD KEY status (status);" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_Photos_to_Storage','Attach/edit the pictures uploaded with the \"create_photos_manager_interface()\" function');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFIELDDESC VALUES ('Upload_Photos',NULL,'','R',NULL,NULL,NULL,NULL,NULL,'\"\"\"\r\nThis is an example of element that creates a photos upload interface.\r\nClone it, customize it and integrate it into your submission. Then add function \r\n\'Move_Photos_to_Storage\' to your submission functions list, in order for files \r\nuploaded with this interface to be attached to the record. More information in \r\nthe WebSubmit admin guide.\r\n\"\"\"\r\n\r\nfrom invenio.websubmit_functions.ParamFile import ParamFromFile\r\nfrom invenio.websubmit_functions.Move_Photos_to_Storage import read_param_file, create_photos_manager_interface, get_session_id\r\n\r\n# Retrieve session id\r\ntry:\r\n # User info is defined only in MBI/MPI actions...\r\n session_id = get_session_id(None, uid, user_info) \r\nexcept:\r\n session_id = get_session_id(req, uid, {})\r\n\r\n# Retrieve context\r\nindir = curdir.split(\'/\')[-3]\r\ndoctype = curdir.split(\'/\')[-2]\r\naccess = curdir.split(\'/\')[-1]\r\n\r\n# Get the record ID, if any\r\nsysno = ParamFromFile(\"%s/%s\" % (curdir,\'SN\')).strip()\r\n\r\n\"\"\"\r\nModify below the configuration of the photos manager interface.\r\nNote: \'can_reorder_photos\' parameter is not yet fully taken into consideration\r\n\r\nDocumentation of the function is available by running:\r\necho -e \'from invenio.websubmit_functions.Move_Photos_to_Storage import create_photos_manager_interface as f\\nprint f.__doc__\' | python\r\n\"\"\"\r\ntext += create_photos_manager_interface(sysno, session_id, uid,\r\n doctype, indir, curdir, access,\r\n can_delete_photos=True,\r\n can_reorder_photos=True,\r\n can_upload_photos=True,\r\n editor_width=700,\r\n editor_height=400,\r\n initial_slider_value=100,\r\n max_slider_value=200,\r\n min_slider_value=80)','0000-00-00','0000-00-00',NULL,NULL,0);" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Photos_to_Storage','iconsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFIELDDESC VALUES ('Upload_Files',NULL,'','R',NULL,NULL,NULL,NULL,NULL,'\"\"\"\r\nThis is an example of element that creates a file upload interface.\r\nClone it, customize it and integrate it into your submission. Then add function \r\n\'Move_Uploaded_Files_to_Storage\' to your submission functions list, in order for files \r\nuploaded with this interface to be attached to the record. More information in \r\nthe WebSubmit admin guide.\r\n\"\"\"\r\nfrom invenio.websubmit_managedocfiles import create_file_upload_interface\r\nfrom invenio.websubmit_functions.Shared_Functions import ParamFromFile\r\n\r\nindir = ParamFromFile(os.path.join(curdir, \'indir\'))\r\ndoctype = ParamFromFile(os.path.join(curdir, \'doctype\'))\r\naccess = ParamFromFile(os.path.join(curdir, \'access\'))\r\ntry:\r\n sysno = int(ParamFromFile(os.path.join(curdir, \'SN\')).strip())\r\nexcept:\r\n sysno = -1\r\nln = ParamFromFile(os.path.join(curdir, \'ln\'))\r\n\r\n\"\"\"\r\nRun the following to get the list of parameters of function \'create_file_upload_interface\':\r\necho -e \'from invenio.websubmit_managedocfiles import create_file_upload_interface as f\\nprint f.__doc__\' | python\r\n\"\"\"\r\ntext = create_file_upload_interface(recid=sysno,\r\n print_outside_form_tag=False,\r\n include_headers=True,\r\n ln=ln,\r\n doctypes_and_desc=[(\'main\',\'Main document\'),\r\n (\'additional\',\'Figure, schema, etc.\')],\r\n can_revise_doctypes=[\'*\'],\r\n can_describe_doctypes=[\'main\'],\r\n can_delete_doctypes=[\'additional\'],\r\n can_rename_doctypes=[\'main\'],\r\n sbm_indir=indir, sbm_doctype=doctype, sbm_access=access)[1]\r\n','0000-00-00','0000-00-00',NULL,NULL,0);" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Uploaded_Files_to_Storage','forceFileRevision');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Create_Upload_Files_Interface','Display generic interface to add/revise/delete files. To be used before function \"Move_Uploaded_Files_to_Storage\"');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_Uploaded_Files_to_Storage','Attach files uploaded with \"Create_Upload_Files_Interface\"')" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','elementNameToDoctype');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','createIconDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','createRelatedFormats');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','iconsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Revised_Files_to_Storage','keepPreviousVersionDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_Revised_Files_to_Storage','Revise files initially uploaded with \"Move_Files_to_Storage\"')" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','maxsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','minsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','doctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','restrictions');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canDeleteDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canReviseDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canDescribeDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canCommentDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canKeepDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canAddFormatDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canRestrictDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canRenameDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','canNameNewFiles');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','createRelatedFormats');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','keepDefault');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','showLinks');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','fileLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','filenameLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','descriptionLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','commentLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','restrictionLabel');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','startDoc');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','endDoc');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','defaultFilenameDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Create_Upload_Files_Interface','maxFilesDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Uploaded_Files_to_Storage','iconsize');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Uploaded_Files_to_Storage','createIconDoctypes');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Report_Number_Generation','nblength');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Second_Report_Number_Generation','2nd_nb_length');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Get_Recid','record_search_pattern');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmALLFUNCDESCR VALUES ('Move_FCKeditor_Files_to_Storage','Transfer files attached to the record with the FCKeditor');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_FCKeditor_Files_to_Storage','input_fields');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Uploaded_Files','layer');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Replace_Single_File_Approval','layer');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Replace_Single_File_Approval','switch_file');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Stamp_Uploaded_Files','switch_file');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Files_to_Storage','paths_and_restrictions');" | ${prefix}/bin/dbexec echo "INSERT INTO sbmFUNDESC VALUES ('Move_Files_to_Storage','paths_and_doctypes');" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD round_name varchar(255) NOT NULL default ''" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD restriction varchar(50) NOT NULL default ''" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD in_reply_to_id_cmtRECORDCOMMENT int(15) unsigned NOT NULL default '0'" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD KEY in_reply_to_id_cmtRECORDCOMMENT (in_reply_to_id_cmtRECORDCOMMENT);" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD in_reply_to_id_bskRECORDCOMMENT int(15) unsigned NOT NULL default '0'" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD KEY in_reply_to_id_bskRECORDCOMMENT (in_reply_to_id_bskRECORDCOMMENT);" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD reply_order_cached_data blob NULL default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD reply_order_cached_data blob NULL default NULL;" | ${prefix}/bin/dbexec echo "ALTER TABLE cmtRECORDCOMMENT ADD INDEX (reply_order_cached_data(40));" | ${prefix}/bin/dbexec echo "ALTER TABLE bskRECORDCOMMENT ADD INDEX (reply_order_cached_data(40));" | ${prefix}/bin/dbexec echo -e 'from invenio.webcommentadminlib import migrate_comments_populate_threads_index;\ migrate_comments_populate_threads_index()' | $(PYTHON) echo -e 'from invenio.access_control_firerole import repair_role_definitions;\ repair_role_definitions()' | $(PYTHON) +update-v1.0.0-rc0-tables: # from v1.0.0-rc0 to v1.0.0 + @echo "Nothing to do; table structure did not change between v1.0.0-rc0 and v1.0.0." + CLEANFILES = *~ *.pyc *.tmp diff --git a/NEWS b/NEWS index 20464829f..305d51057 100644 --- a/NEWS +++ b/NEWS @@ -1,1190 +1,1311 @@ Invenio NEWS ============ Here is a short summary of the most notable changes in Invenio releases. For more information about the current release, please consult RELEASE-NOTES. For more information about changes, please consult ChangeLog. +Invenio v1.0.0 -- released 2012-02-29 +------------------------------------- + + *) BatchUploader: fix retrieval of recs from extoaiid + + *) BibCirculation: fix regexp for dictionary checking; security check + before eval + + *) BibConvert: fix UP and DOWN for UTF-8 strings + + *) bibdocfile: add missing normalize_format() calls; + check_bibdoc_authorization caseless; fix append WRT + description/restriction; fix cli_set_batch function; fix + documentation WRT --with-version; fix handling of embargo firerole + rule; fix parsing of complex subformats + + *) BibEdit: fix crash in Ajax request; fix undefined dictionary key + + *) BibFormat: better escape BFE in admin test UI; do not exit if no + XSLT processor found; fix regression test; fix URL to ejournal + resolver; fix XSLT formatting of MARCXML snippets; removes 'No + fulltext' message; special handling of INSPIRE-PUBLIC type; use + default namespace in XSL + + *) BibHarvest: check for empty resumptionToken; fix MARCXML creation + in OAI updater; optional JSON dependency + + *) BibIndex: fix author:Campbell-Wilson word query; fix + double-stemming upon indexing; fix Porter stemmer in multithread; + Greek stemmer improvements + + *) BibKnowledge: make XML/XSLT libs optional + + *) BibRank: CERN hack to inactivate similarity lists; fix citation + indexer time stamp updating; fix citation indexing of deleted + records; fix citedby/refersto for infinite sets; fix empty + citation data cacher; fix incremental citation indexer leaks; make + numpy optional; minimum x-axis in citation history graphs; run + citation indexer after word indexer + + *) BibRecord: fix for record_get_field_instances() + + *) BibSched: fix guess_apache_process_user_from_ps; use larger + timouts for launching tasks + + *) BibUpload: FFT regression tests not to use CDS + + *) htmlutils: fix FCKeditor upload URLs + + *) installation: add note about optional hashlib; change table TYPE + to ENGINE in SQL; fix 'install-mathjax-plugin'; fix issue with + FCKeditor; fix 'make install-jquery-plugins'; fix output message + cosmetics; new 'make install-ckeditor-plugin'; re-enable WSGI + pre-loading + + *) intbitset: fix never ending loop in __repr__; fix several memory + leaks + + *) inveniocfg: fix resetting ranking method names + + *) inveniogc: new CLI options check/optimise tables + + *) kwalitee: grep-like output and exit status changes; use + `--check-some` as default CLI option + + *) mailutils: remove unnecessary 'multipart/related' + + *) plotextractor: fix INSPIRE unit test + + *) textmarc2xmlmarc: fix handling of BOM + + *) urlutils: new Indico request generator helper + + *) WebAccess: fix Access policy page; fix FireRole handling integer + uid; fix retrieving emails from firerole + + *) WebAlert: fix the display of records in alerts + + *) WebBasket: fix missing return statement; fix number of items in + public baskets + + *) WebComment: CERN-specific hack for ATLAS comments; fix discussion + display in bfe_comments; fix washing of email to admin; improve + sanity checks + + *) WebHelp: HOWTO MARC document update + + *) WebJournal: fix seminar widget encoding issue; fix seminar widget + for new Indico APIs; update weather widget for new APIs + + *) WebSearch: add refersto:/a b c/ example to guide; CERN-specific + hack for journal sorting; CERN-specific hack for latest additions; + fix case-insensitive collection search; fix CDSIndico external + search; fix collection translation in admin UI; fix + get_fieldvalues() when recid is str; fix + get_index_id_from_field(); fix structured regexp query parsing; + fix symbol name typo in loop checking; parenthesised collection + definitions; remove accent-search warning in guide; remove Report + for INSPIRE author pages; replace CDS Indico by Indico; updates + some output phrases + + *) WebSession: fix crash when no admin user exists + + *) WebStyle: better service failure message; fix implementation of + req.get_hostname; fluid width of the menu; pre-load citation + dictionaries for web + + *) WebSubmit: avoid printing empty doctype section; + check_user_can_view_record in publiline; fix filename bug in + document manager; fix handling of uploaded files; fix + record_search_pattern in DEMOJRN + + *) xmlmarclint: 'no valid record detected' error + + *) I18N: updates to Catalan, Czech, French, German, Greek, Italian, + Slovak, and Spanish translations + + *) Note: for a complete list of new features in Invenio v1.0 release + series over Invenio v0.99 release series, please see: + + CDS Invenio v0.99.5 -- released 2012-02-21 ------------------------------------------ *) improved sanity checks when reporting, voting, or replying to a comment, or when accessing comment attachments, preventing URL mangling attempts (WebComment) CDS Invenio v0.99.4 -- released 2011-12-19 ------------------------------------------ - *) fixed double stemming during indexing (BibRank) + *) fixed double stemming during indexing (BibIndex) *) fixed collection translation in admin UI (WebSearch) *) fixed UP and DOWN functions for UTF-8 strings (BibConvert) Invenio v1.0.0-rc0 -- released 2010-12-21 ----------------------------------------- *) CDS Invenio becomes Invenio as of this release *) new facility of hosted collections; support for external records in search collections, user alerts and baskets (WebSearch, WebAlert, WebBasket) *) support for nested parentheses in search query syntax (WebSearch) *) new refersto/citedby search operators for second-order searches in citation map (BibRank, WebSearch) *) numerous improvements to SPIRES query syntax parser (WebSearch) *) enhancement to search results summaries, e.g. co-author lists on author pages, e.g. h-index (WebSearch) *) new support for unAPI, Zotero, OpenSearch, AWS (WebSearch) *) new phrase and word-pair indexes (BibIndex) *) new fuzzy author name matching mode (BibIndex) *) new time-dependent citation ranking family of methods (BibRank) *) full-text search now shows context snippets (BibFormat) *) improvements to the basket UI, basket export facility (WebBasket) *) new support for FCKeditor in submissions and user comments, possibility to attach files (WebComment, WebSubmit) *) commenting facility enhanced with rounds and threads (WebComment) *) new facility to moderate user comments (WebComment) *) enhanced CLI tool for document file management bringing new options such as hidden file flag (WebSubmit) *) numerous improvements to the submission system, e.g. asynchronous JavaScript upload support, derived document formats, icon creation, support for automatic conversion of OpenOffice documents, PDF/A, OCR (WebSubmit) *) new full-text file metadata reader/writer tool (WebSubmit) *) new experimental SWORD protocol client application (BibSword) *) complete rewrite of the record editor using Ajax technology for faster user operation, with new features such as field templates, cloning, copy/paste, undo/redo, auto-completion, etc (BibEdit) *) new multi-record editor to alter many records in one go (BibEdit) *) new Ajax-based record differ and merger (BibMerge) *) new fuzzy record matching mode, with possibility to match records against remote Invenio installations (BibMatch) *) new circulation and holdings module (BibCirculation) *) new facility for matching provenance information when uploading records (BibUpload) *) new possibility of uploading incoming changes into holding pen (BibUpload) *) new batch uploader facility to support uploading of metadata files and of full-text files either in CLI or over web (BibUpload) *) new record exporting module supporting e.g. Sitemap and Google Scholar export methods (BibExport) *) improvements to the keyword classifier, e.g. author and core keywords (BibClassify) *) new facility for external robot-like login method (WebAccess) *) numerous improvements to the journal creation facility, new journal `Atlantis Times' demo journal (WebJournal) *) refactored and improved OAI exporter and harvester (BibHarvest) *) new taxonomy-based and dynamic-query knowledge base types (BibKnowledge) *) possibility to switch on/off user features such as alerts and baskets based on RBAC rules (WebAccess and other modules) *) various improvements to task scheduler, for example better communication with tasks, possibility to run certain bibsched tasks within given time limit, etc (BibSched) *) new database dumper for backup purposes (MiscUtil) *) new plotextractor library for extracting plots from compuscripts, new figure caption index and the Plots tab (MiscUtil, BibIndex, Webearch) *) enhanced reference extrator, e.g. support for DOI, for author name recognition (MiscUtil) *) new register emergency feature e.g. to alert admins by SMS in case the task queue stops (MiscUtil) *) infrastructure move from mod_python to mod_wsgi, support for mod_xsendfile (WebStyle and many modules) *) infrastructure move from jsMath to MathJax (MiscUtil) *) some notable backward-incompatible changes: removed authentication methods related to Apache user and group files, changed BibFormat element's API (BibFormat, many modules) *) new translations (Afrikaans, Galician, Georgian, Romanian, Kinyarwanda) plus many translation updates *) other numerous improvements and bug fixes done in about 1600 commits over Invenio v0.99 series CDS Invenio v0.99.3 -- released 2010-12-13 ------------------------------------------ *) fixed issues in the harvesting daemon when harvesting from more than one OAI repository (BibHarvest) *) fixed failure in formatting engine when dealing with not-yet-existing records (BibFormat) *) fixed traversal of final URL parts in the URL dispatcher (WebStyle) *) improved bibdocfile URL recognition upon upload of MARC files (BibUpload) *) fixed bug in admin interface for adding authorizations (WebAccess) *) keyword extractor is now compatible with rdflib releases older than 2.3.2 (BibClassify) *) output of `bibsched status' now shows the queue mode status as AUTOMATIC or MANUAL to help queue monitoring (BibSched) CDS Invenio v0.99.2 -- released 2010-10-20 ------------------------------------------ *) stricter checking of access to restricted records: in order to view a restricted record, users are now required to have authorizations to access all restricted collections the given record may belong to (WebSearch) *) strict checking of user query history when setting up email notification alert, preventing URL mangling attempts (WebAlert) *) fixed possible Unix signal conflicts for tasks performing I/O operations or running external processes, relevant notably to full-text indexing of remote files (BibSched) *) fixed full-text indexing and improved handling of files of `unexpected' extensions (BibIndex, WebSubmit) *) streaming of files of `unknown' MIME type now defaults to application/octet-stream (WebSubmit) *) fixed addition of new MARC fields in the record editor (BibEdit) *) fixed issues in full-text file attachment via MARC (BibUpload) *) fixed authaction CLI client (WebAccess) *) ... plus other minor fixes and improvements CDS Invenio v0.99.1 -- released 2008-07-10 ------------------------------------------ *) search engine syntax now supports parentheses (WebSearch) *) search engine syntax now supports SPIRES query language (WebSearch) *) strict respect for per-collection sort options on the search results pages (WebSearch) *) improved parsing of search query with respect to non-existing field terms (WebSearch) *) fixed "any collection" switch on the search results page (WebSearch) *) added possibility for progressive display of detailed record page tabs (WebSearch) *) added support for multi-page RSS output (WebSearch) *) new search engine summarizer module with the cite summary output format (WebSearch, BibRank) *) "cited by" links are now generated only when needed (WebSearch) *) new experimental comprehensive author page (WebSearch) *) stemming for many indexes is now enabled by default (BibIndex) *) new intelligent journal index (BibIndex) *) new logging of missing citations (BibRank) *) citation indexer and searcher improvements and caching (BibRank) *) new low-level task submission facility (BibSched) *) new options in bibsched task monitor: view task options, log and error files; prune task to a history table; extended status reporting; failed tasks now need acknowledgement in order to restart the queue (BibSched) *) safer handling of task sleeping and waking up (BibSched) *) new experimental support for task priorities and concurrent task execution (BibSched) *) improved user-configured browser language matching (MiscUtil) *) new default behaviour not differentiating between guest users; this removes a need to keep sessions/uids for guests and robots (WebSession) *) optimized sessions and collecting external user information (WebSession) *) improved logging conflicts for external vs internal users (WebAccess) *) improved Single Sign-On session preservation (WebAccess) *) new 'become user' debugging facility for admins (WebAccess) *) new bibdocfile CLI tool to manipulate full-text files archive (WebSubmit) *) optimized redirection of old URLs (WebSubmit) *) new icon creation tool in the submission input chain (WebSubmit) *) improved full-text file migration tool (WebSubmit) *) improved stamping of full-text files (WebSubmit) *) new approval-related end-submission functions (WebSubmit) *) comments and descriptions of full-text files are now kept also in bibdoc tables, not only in MARC; they are synchronized during bibupload (WebSubmit, BibUpload) *) fixed navigation in public baskets (WebBasket) *) added detailed record page link to basket records (WebBasket) *) new removal of HTML markup in alert notification emails (WebAlert) *) improved OAI harvester logging and handling (BibHarvest) *) improved error checking (BibConvert) *) improvements to the record editing tool: subfield order change, repetitive subfields; improved record locking features; configurable per-collection curators (BibEdit) *) fully refactored WebJournal module (WebJournal) *) new RefWorks output format, thanks to Theodoros Theodoropoulos (BibFormat) *) fixed keyword detection tool's output; deactivated taxonomy compilation (BibClassify) *) new /stats URL for administrators (WebStat) *) better filtering of unused translations (WebStyle) *) updated French, Italian, Norwegian and Swedish translations; updated Japanese translation (thanks to Makiko Matsumoto and Takao Ishigaki); updated Greek translation (thanks to Theodoros Theodoropoulos); new Hungarian translation (thanks to Eva Papp) *) ... plus many other minor bug fixes and improvements CDS Invenio v0.99.0 -- released 2008-03-27 ------------------------------------------ *) new Invenio configuration language, new inveniocfg configuration tool permitting more runtime changes and enabling separate local customizations (MiscUtil) *) phased out WML dependency everywhere (all modules) *) new common RSS cache implementation (WebSearch) *) improved access control to the detailed record pages (WebSearch) *) when searching non-existing collections, do not revert to searching in public Home anymore (WebSearch) *) strict calculation of number of hits per multiple collections (WebSearch) *) propagate properly language environment in browse pages, thanks to Ferran Jorba (WebSearch) *) search results sorting made accentless, thanks to Ferran Jorba (WebSearch) *) new OpenURL interface (WebSearch) *) added new search engine API argument to limit searches to record creation/modification dates and times instead of hitherto creation dates only (WebSearch) *) do not allow HTTP POST method for searches to prevent hidden mining (WebSearch) *) added alert and RSS teaser for search engine queries (WebSearch) *) new optimized index structure for fast integer bit vector operations, leading to significant indexing time improvements (MiscUtil, BibIndex, WebSearch) *) new tab-based organisation of detailed record pages, with new URL schema (/record/1/usage) and related CSS changes (BibFormat, MiscUtil, WebComment, WebSearch, WebStyle, WebSubmit) *) phased out old PHP based code; migration to Python-based output formats recommended (BibFormat, WebSubmit) *) new configurability to show/hide specific output formats for specific collections (BibFormat, WebSearch) *) new configurability to have specific stemming settings for specific indexes (BibIndex, WebSearch) *) optional removal of LaTeX markup for indexer (BibIndex, WebSearch) *) performance optimization for webcoll and optional arguments to refresh only parts of collection cache (WebSearch) *) optional verbosity argument propagation to the output formatter (BibFormat, WebSearch) *) new convenient reindex option to the indexer (BibIndex) *) fixed problem with indexing of some lengthy UTF-8 accented names, thanks to Theodoros Theodoropoulos for reporting the problem (BibIndex) *) fixed full-text indexing of HTML pages (BibIndex) *) new Stemmer module dependency, fixes issues on 64-bit systems (BibIndex) *) fixed download history graph display (BibRank) *) improved citation ranking and history graphs, introduced self-citation distinction, added new demo records (BibRank) *) fixed range redefinition and output message printing problems in the ranking indexer, thanks to Mike Marino (BibRank) *) new XSLT output formatter support; phased out old BFX formats (BibFormat) *) I18N output messages are now translated in the output formatter templates (BibFormat) *) formats fixed to allow multiple author affiliations (BibFormat) *) improved speed of the record output reformatter in case of large sets (BibFormat) *) support for displaying LaTeX formulas via JavaScript (BibFormat) *) new and improved output formatter elements (BibFormat) *) new escaping modes for format elements (BibFormat) *) output format template editor cache and element dependency checker improvements (BibFormat) *) output formatter speed improvements in PHP-compatible mode (BibFormat) *) new demo submission configuration and approval workflow examples (WebSubmit) *) new submission full-text file stamper utility (WebSubmit) *) new submission icon-creation utility (WebSubmit) *) separated submission engine and database layer (WebSubmit) *) submission functions can now access user information (WebSubmit) *) implemented support for restricted icons (WebSubmit, WebAccess) *) new full-text file URL and cleaner storage facility; requires file names to be unique within a given record (WebSearch, WebSubmit) *) experimental release of the complex approval and refereeing workflow (WebSubmit) *) new end-submission functions to move files to storage space (WebSubmit) *) added support for MD5 checking of full-text files (WebSubmit) *) improved behaviour of the submission system with respect to the browser "back" button (WebSubmit) *) removed support for submission "cookies" (WebSubmit) *) flexible report number generation during submission (WebSubmit) *) added support for optional filtering step in the OAI harvesting chain (BibHarvest) *) new text-oriented converter functions IFDEFP, JOINMULTILINES (BibConvert) *) selective harvesting improvements, sets, non-standard responses, safer resumption token handling (BibHarvest) *) OAI archive configuration improvements: collections retrieval, multiple set definitions, new clean mode, timezones, and more (BibHarvest) *) OAI gateway improvements: XSLT used to produce configurable output (BibHarvest) *) added support for "strong tags" that can resist metadata replace mode (BibUpload) *) added external OAI ID tag support to the uploader (BibUpload) *) added support for full-text file transfer during uploading (BibUpload) *) preserving full history of all MARCXML versions of a record (BibEdit, BibUpload) *) XMLMARC to TextMarc improvements: empty indicators and more (BibEdit) *) numerous reference extraction tool improvements: year handling, LaTeX handling, URLs, journal titles, output methods, and more (BibEdit) *) new classification daemon (BibClassify) *) classification taxonomy caching resulting in speed optimization (BibClassify) *) new possibility to define more than one keyword taxonomy per collection (BibClassify) *) fixed non-standalone keyword detection, thanks to Annette Holtkamp (BibClassify) *) new embedded page generation profiler (WebStyle) *) new /help pages layout and webdoc formatting tool (WebStyle) *) new custom style template verification tool (WebStyle) *) added support for the XML page() output format, suitable for AJAX interfaces (WebStyle) *) introduction of navigation menus (WebStyle) *) general move from HTML to XHTML markup (all modules) *) fixed alert deletion tool vulnerability (WebAlert) *) do not advertise baskets/alerts much for guest users; show only the login link (WebSession) *) password reset interface improvements (WebSession) *) new permanent "remember login" mechanism (WebSession, WebAccess) *) local user passwords are now encrypted (WebSession, WebAccess) *) new LDAP external authentication plugin (WebAccess) *) new password reset mechanism using new secure mail cookies and temporary role membership facilities (WebAccess, WebSession) *) added support for Single Sign-On Shibboleth based authentication method (WebAccess) *) new firewall-like based role definition language, new demo examples (WebAccess) *) external authentication and groups improvements: nicknames, account switching, and more (WebSession, WebAccess) *) task log viewer integrated in the task monitor (BibSched) *) new journal creation module (WebJournal) *) new generic statistic gathering and display facility (WebStat) *) deployed new common email sending facility (MiscUtil, WebAlert, WebComment, WebSession, WebSubmit) *) dropped support for MySQL-4.0, permitting to use clean and strict UTF-8 storage methods; upgrade of MySQLdb to at least 1.2.1_p2 required (MiscUtil) *) uncatched exceptions are now being sent by email to the administrator (MiscUtil, WebStyle) *) new general garbage collector with a possibility to run via the task scheduler and a possibility to clean unreferenced bibliographic values (MiscUtil) *) new generic SQL and data cacher (MiscUtil) *) new HTML page validator plugin (MiscUtil) *) new web test suite running in a real browser (MiscUtil) *) improved code kwalitee checker (MiscUtil) *) translation updates: Spanish and Catalan (thanks to Ferran Jorba), Japanese (Toru Tsuboyama), German (Benedikt Koeppel), Polish (Zbigniew Szklarz and Zbigniew Leonowicz), Greek (Theodoros Theodoropoulos), Russian (Yana Osborne), Swedish, Italian, French *) new translations: Chinese traditional and Chinese simplified (thanks to Kam-ming Ku) *) ... plus many other minor bug fixes and improvements CDS Invenio v0.92.1 -- released 2007-02-20 ------------------------------------------ *) new support for external authentication systems (WebSession, WebAccess) *) new support for external user groups (WebSession) *) new experimental version of the reference extraction program (BibEdit) *) new optional Greek stopwords list, thanks to Theodoropoulos Theodoros (BibIndex) *) new Get_Recid submission function (WebSubmit) *) new config variable governing the display of the download history graph (BibRank) *) started deployment of user preferences (WebSession, WebSearch) *) split presentation style for "Narrow search", "Focus on" and "Search also" search interface boxes (WebSearch, WebStyle) *) updated CERN Indico and KEK external collection searching facility (WebSearch) *) fixed search interface portalbox and collection definition escaping behaviour (WebSearch Admin) *) fixed problems with external system number and OAI ID matching (BibUpload) *) fixed problem with case matching behaviour (BibUpload) *) fixed problems with basket record display and basket topic change (WebBasket) *) fixed output format template attribution behaviour (BibFormat) *) improved language context propagation in output formats (BibFormat) *) improved output format treatment of HTML-aware fields (BibFormat) *) improved BibFormat migration kit (BibFormat) *) improved speed and eliminated set duplication of the OAI repository gateway (BibHarvest) *) fixed resumption token handling (BibHarvest) *) improved record editing interface (BibEdit) *) fixed problem with empty fields treatment (BibConvert) *) updated Report_Number_Generation submission function to be able to easily generate report numbers from any submission information (WebSubmit) *) fixed problem with submission field value escaping (WebSubmit) *) fixed problem with submission collection ordering (WebSubmit) *) fixed BibSched task signal handling inconsistency (BibSched) *) fixed TEXT versus BLOB database problems for some tables/columns *) minor updates to the HOWTO Migrate guide and several admin guides (WebHelp, BibIndex, BibFormat) *) minor bugfixes to several modules; see ChangeLog for details and credits CDS Invenio v0.92.0 -- released 2006-12-22 ------------------------------------------ *) previously experimental output formatter in Python improved and made default (BibFormat) *) previously experimental new submission admin interface in Python improved and made default (WebSubmit) *) new XML-oriented output formatting mode (BibFormat) *) new export-oriented output formats: EndNote, NLM (BibFormat) *) RSS 2.0 latest additions feed service (WebSearch, BibFormat) *) new XML-oriented metadata converter mode (BibConvert) *) new metadata uploader in Python (BibUpload) *) new integrated parallel external collection searching (WebSearch) *) improved document classifier: composite keywords, wildcards, cloud output (BibClassify) *) improved UTF-8 fulltext indexing (BibIndex) *) improved external login authentication subsystem (WebAccess) *) added possibility to order submission categories (WebSubmit) *) improved handling of cached search interface page formats, preferential sort pattern functionality, international collection names (WebSearch) *) improved behaviour of OAI harvester: sets, deleted records, harvested metadata transformation (BibHarvest) *) improved MARCXML schema compatibility concerning indicators; updates to the HTML MARC output format (BibEdit, BibUpload, BibFormat, and other modules) *) multiple minor bugs fixed thanks to the wider deployment of the regression test suite (all modules) *) new translation (Croatian) and several translation updates (Catalan, Bulgarian, French, Greek, Spanish); thanks to Ferran Jorba, Beatriu Piera, Alen Vodopijevec, Jasna Marković, Theodoros Theodoropoulos, and Nikolay Dyankov (see also THANKS file) *) removed dependency on PHP; not needed anymore *) full compatibility with MySQL 4.1 and 5.0; upgrade from MySQL 4.0 now recommended *) full compatibility with FreeBSD and Mac OS X CDS Invenio v0.90.1 -- released 2006-07-23 ------------------------------------------ *) output messages improved and enhanced to become more easily translatable in various languages (all modules) *) new translation (Bulgarian) and several updated translations (Greek, French, Russian, Slovak) *) respect langugage choice in various web application links (WebAlert, WebBasket, WebComment, WebSession, WebSubmit) *) fixed problem with commenting rights in a group-shared basket that is also a public basket with lesser rights (WebBasket) *) guest users are now forbidden to share baskets (WebBasket) *) fixed guest user garbage collection, adapted to the new baskets schema (WebSession) *) added possibility to reject group membership requests; sending informational messages when users are approved/refused by group administrators (WebSession) *) experimental release of the new BibFormat in Python (BibFormat) *) started massive deployment of the regression test suite, checking availability of all web interface pages (BibEdit, BibFormat, BibHarvest, BibIndex, BibRank, MiscUtil, WebAccess, WebBasket, WebComment, WebMessage, WebSearch, WebSession, WebSubmit) *) updated developer documentation (I18N output messages policy, test suite policy, coding style) CDS Invenio v0.90.0 -- released 2006-06-30 ------------------------------------------ *) formerly known as CDSware; the application name change clarifies the relationship with respect to the CDS Sofware Consortium producing two flagship applications (CDS Indico and Invenio) *) version number increased to v0.90 in the anticipation of the forthcoming v1.0 release after all the major codebase changes are now over *) new possibility to define user groups (WebGroup) *) new personal basket organization in topics (WebBasket) *) new basket sharing among user groups (WebBasket) *) new open peer reviewing and commenting on documents (WebComment) *) new user and group web messaging system (WebMessage) *) new ontology-based document classification system (BibClassify) *) new WebSubmit Admin (WebSubmit) *) new record editing web interface (BibEdit) *) new record matching tool (BibMatch) *) new OAI repository administration tool (BibHarvest) *) new OAI periodical harvesting tool (BibHarvest) *) new web layout templating system (WebStyle) *) new clean URL schema (e.g. /collection/Theses, /record/1234) (WebStyle) *) new BibTeX output format support (BibFormat) *) new possibility of secure HTTPS authentication while keeping the rest of the site non-HTTPS (WebSession) *) new centralized error library (MiscUtil) *) new gettext-based international translations, with two new beta translations (Japanese, Polish) *) new regression testing suite framework (MiscUtil) *) new all prerequisites are now apt-gettable for Debian "Sarge" GNU/Linux *) new full support for Mac OS X *) ... plus many fixes and changes worth one year of development CDSware v0.7.1 -- released 2005-05-04 ------------------------------------- *) important bugfix for bibconvert's ``source data in a directory'' mode, as invoked by the web submission system (BibConvert) *) minor bugfix in the search engine, thanks to Frederic Gobry (WebSearch) *) minor bugfix in the WebSearch Admin interface (WebSearch) *) automatic linking to Google Print in the ``Haven't found what you were looking for...'' page box (WebSearch) *) BibFormat Admin Guide cleaned, thanks to Ferran Jorba *) new Catalan translation, thanks to Ferran Jorba *) updated Greek and Portuguese translations, thanks to Theodoros Theodoropoulos and Flávio C. Coelho *) updated Spanish translation CDSware v0.7.0 -- released 2005-04-06 ------------------------------------- *) experimental release of the refextract program for automatic reference extraction from PDF fulltext files (BibEdit) *) experimental release of the citation and download ranking tools (BibRank) *) new module for gathering usage statistics out of Apache log files (WebStat) *) new similar-records-navigation tool exploring end-user viewing habits: "people who viewed this page also viewed" (WebSearch, BibRank) *) OAI gateway validated against OAI Repository Explorer (BibHarvest) *) fixed "records modified since" option for the indexer (BibIndex) *) collection cache update is done only when the cache is not up to date (WebSearch) [closing #WebSearch-016] *) cleanup of user login mechanism (WebSession, WebAccess) *) fixed uploading of already-existing records in the insertion mode (BibUpload) *) fixed submission in UTF-8 languages (WebSubmit) *) updated HOWTO Run Your Existing CDSware Installation (WebHelp) *) test suite improvements (WebSearch, BibHarvest, BibRank, BibConvert) *) German translation updated and new German stopwords list added, thanks to Guido Pelzer *) new Greek and Ukrainian translations, thanks to Theodoros Theodoropoulos and Vasyl Ostrovskyi *) all language codes now comply to RFC 1766 and ISO 639 *) numerous other small fixes and improvements, with many contributions by the EPFL team headed by Frederic Gobry (BibConvert, BibUpload, WebSearch, WebSubmit, WebSession) CDSware v0.5.0 -- released 2004-12-17 ------------------------------------- *) new rank engine, featuring word similarity rank method and the journal impact factor rank demo (BibRank) *) search engine includes ranking option (WebSearch) *) record similarity search based on word frequency (WebSearch, BibRank) *) stopwords possibility when ranking and indexing (BibRank, BibIndex) *) stemming possibility when ranking and indexing (BibRank, BibIndex) *) search engine boolean query processing stages improved (WebSearch) *) search engine accent matching in phrase searches (WebSearch) *) regular expression searching mode introduced into the Simple Search interface too (WebSearch) *) Search Tips split into a brief Search Tips page and detailed Search Guide page (WebSearch) *) improvements to the ``Try your search on'' hints (WebSearch) *) author search hints introduced (WebSearch) *) search interface respects title prologue/epilogue portalboxes (WebSearch) *) improvements to admin interfaces (WebSearch, BibIndex, BibRank, WebAccess) *) basket item ordering problem fixed (WebBasket) *) access error messages introduced (WebAccess and its clients) *) new account management to enable/disable guest users and automatic vs to-be-approved account registration (WebAccess) *) possibility for temporary read-only access to, and closure of, the site; useful for backups (WebAccess and its clients) *) possibility for external authentication login methods (WebAccess) *) new XML MARC handling library (BibEdit) *) when uploading, bad XML records are marked as errors (BibUpload) *) improvements to the submission engine and its admin interface, thanks to Tiberiu Dondera (WebSubmit) *) preparations for electronic mail submission feature, not yet functional (ElmSubmit) *) added example on MARC usage at CERN (WebHelp) *) legacy compatibility with MySQL 3.23.x assured (BibUpload) *) legacy compatibility with Python 2.2 assured (WebSubmit) *) test suite additions and corrections (BibRank, BibIndex, WebSearch, BibEdit) *) French translation fixes, thanks to Eric Grand *) minor Czech and Slovak translation cleanup CDSware v0.3.3 (DEVELOPMENT) -- released 2004-07-16 --------------------------------------------------- *) new international phrases, collection and field names; thanks to Guido, Flavio, Tullio *) collection international names are now respected by the search engine and interfaces (WebSearch) *) field international names are now respected by the search engine and interfaces (WebSearch) *) when no hits found in a given collection, do not display all public hits straight away but only link to them (WebSearch) *) records marked as DELETED aren't shown anymore in XML MARC and other formats (WebSearch) *) detailed record page now features record creation and modification times (WebSearch) *) improved XML MARC parsing and cumulative record count in case of uploading of several files in one go (BibUpload) *) personal `your admin activities' page introduced (WebSession) *) added option to fulltext-index local files only (BibIndex) *) initial release of the BibIndex Admin interface (BibIndex) *) checking of mandatory selection box definitions (WebSubmit) *) WebSearch Admin interface cleanup (WebSearch) *) introducing common test suite infrastructure (WebSearch, BibIndex, MiscUtil, WebHelp) *) fixed accent and link problems for photo demo records (MiscUtil) *) conference title exported via OAI XML DC (BibHarvest) *) enabled building out of source directory; thanks to Frederic CDSware v0.3.2 (DEVELOPMENT) -- released 2004-05-12 --------------------------------------------------- *) admin area improved: all the modules have now Admin Guides; some guides were updated, some are still to be updated (WebHelp, BibConvert, BibFormat, BibIndex, BibSched, WebAlert, WebSession, WebSubmit, BibEdit, BibHarvest, BibRank, BibUpload, WebAccess, WebBasket, WebSearch, WebStyle) *) initial release of the WebSearch Admin interface (WebSearch) *) initial release of the BibRank Admin interface (BibRank) *) search cache expiry after insertion of new records (WebSearch) *) search engine now does on-the-fly formatting via BibFormat CLI call to handle restricted site situations (WebSearch) *) webcoll default verbosity decreased for efficiency (WebSearch) *) added BibConvert configuration example for converting XML Dublin Core to XML MARC (BibConvert) *) BibConvert knowledge base mode extended by various case-sensitive matching possibilities (BibConvert) *) fixed various problems with fulltext file names and the submission from MS Windows platform (WebSubmit) *) fixed problem with bibupload append mode not updating XML MARC properly (BibUpload) *) fixed small problems with the submission interface such as multiple fields selection (WebSubmit) *) session revoking and session expiry strengthened (WebSession) *) page design and style sheet updated to better fit large variety of browsers (WebStyle) *) added output format argument for basket display (WebBasket) *) new Swedish translation and updated German, Russian, and Spanish translations; thanks to Urban, Guido, Lyuba, and Magaly *) faster creation of I18N static HTML and PHP files during make CDSware v0.3.1 (DEVELOPMENT) -- released 2004-03-12 --------------------------------------------------- *) security fix preventing exposure of local configuration variables by malicious URL crafting (WebSearch, WebSubmit, WebAlert, WebBasket, WebSession, BibHarvest, MiscUtil) *) initial release of the ranking engine (BibRank) *) new guide on HOWTO Run Your CDSware Installation (WebHelp) *) fixed submit configurations with respect to fulltext links and metadata tags (WebSubmit, MiscUtil) *) Your Account personal corner now shows the list and the status of submissions and approvals (WebSession) *) uniform help and version number option for CLI executables (WebSearch, BibSched, BibIndex, BibRank, BibHarvest, BibConvert, WebAccess, BibFormat, WebSession, WebAlert) *) uniform technique for on-the-fly formatting of search results via `hb_' and `hd_' output format parameters (WebSearch) *) check for presence of pcntl and mysql PHP libraries (BibUpload) CDSware v0.3.0 (DEVELOPMENT) -- released 2004-03-05 --------------------------------------------------- *) new development branch release (important SQL table changes) *) introducing a new submission engine and the end-user web interface (WebSubmit) *) bibupload is now a BibSched task with new options (BibUpload) *) BibWords renamed into BibIndex in the view of future phrase indexing changes (BibIndex) *) more secure DB server connectivity (BibSched) *) record matching functionality (BibConvert) *) character encoding conversion tables (BibConvert) *) Qualified Dublin Core conversion example (BibConvert) *) OAI deleted records policy can now be specified (BibHarvest) *) multi-language collection portalboxes (WebSearch) *) HTML pages now respect language selections (WebSearch, WebHelp) *) minor layout changes (WebStyle) *) updated Russian and other translations *) ChangeLog is now generated from CVS log messages *) plus the usual set of bugfixes (see ChangeLog) CDSware v0.1.2 (DEVELOPMENT) -- released 2003-12-21 --------------------------------------------------- *) development branch release *) fix BibReformat task launching problem (BibFormat) *) fix BibTeX -> XML MARC conversion example (BibConvert) *) updated Spanish translation CDSware v0.1.1 (DEVELOPMENT) -- released 2003-12-19 --------------------------------------------------- *) development branch release *) access control engine now used by BibWords, BibFormat (admin and bibreformat), WebSearch (webcoll), and BibTaskEx *) access control engine admin guide started (WebAccess) *) search engine support for sorting by more than one field (WebSearch) *) more internationalization of the search engine messages (WebSearch) *) new language: Norwegian (bokmÃ¥l) *) simple example for converting BibTeX into XML MARC (BibConvert) *) new optional --with-python configuration option *) Python module detection during configure *) bugfixes: os.tempnam() warning, login page referer, and others CDSware v0.1.0 (DEVELOPMENT) -- released 2003-12-04 --------------------------------------------------- *) development branch release *) search engine redesign to yield five times more search performance for larger sites (WebSearch, BibWords) *) fulltext indexation of PDF, PostScript, MS Word, MS PowerPoint and MS Excel files (WebSearch) *) integrated combined metadata/fulltext/citation search (WebSearch) *) multi-stage search guidance in cases of no exact match (WebSearch) *) OAI-PMH harvestor (BibHarvest) *) bibliographic task scheduler (BibSched) *) automatic daemon mode of the indexer, the formatter and the collection cache generator (BibWords, BibFormat, WebSearch) *) user management and session handling rewrite (WebSession) *) user personalization, document baskets and notification alert system (WebBasket, WebAlert) *) role-based access control engine (WebAccess) *) internationalization of the interface started (currently with Czech, German, English, Spanish, French, Italian, Portuguese, Russian, and Slovak support) *) web page design update (WebStyle) *) introduction of programmer-oriented technical documentation corner (WebHelp) *) source tree reorganization, mod_python technology adopted for most of the modules CDSware v0.0.9 (STABLE) -- released 2002-08-01 ---------------------------------------------- *) first "public" alpha release of CDSware *) recently standardized Library of Congress' MARC XML schema adopted in all CDSware modules as the new default internal XML file format (BibConvert, BibFormat, BibUpload, WebSubmit, WebSearch) *) support for OAI-PMH v2.0 in addition to OAI-PMH v1.1 (WebSearch) *) search interface now honors multiple output formats per collection (BibFormat, WebSearch) *) search interface now honors search fields, search options, and sort options from the database config tables (WebSearch, WebSearch Admin) *) search interface now honors words indexes from the database config tables (BibWords, WebSearch) *) easy reformatting of already uploaded bibliographic records via web admin. tool (BibFormat Admin/Reformat Records) *) new submission form field type ("response") allowing greater flexibility (WebSubmit) [thanks to Frank Sudholt] *) demo site "Atlantis Institute of Science" updated to demonstrate: Pictures collection of photographs; specific per-collection formats; references inside Articles and Preprints; "cited by" search link; published version linking; subject category searching; search within, search options, sort options in the web collection pages. - end of file - diff --git a/RELEASE-NOTES b/RELEASE-NOTES index 653d7f2e1..a10e165cb 100644 --- a/RELEASE-NOTES +++ b/RELEASE-NOTES @@ -1,159 +1,177 @@ -------------------------------------------------------------------- -Invenio v1.0.0-rc0 is released -December 21, 2010 +Invenio v1.0.0 is released +February 29, 2012 http://invenio-software.org/ -------------------------------------------------------------------- -Invenio v1.0.0-rc0 was released on December 21, 2010. +Invenio v1.0.0 was released on February 29, 2012. -This is the initial release candidate for Invenio v1.0.0. It is well -tested and stable but it contains a few known issues that we plan to -address in a forthcoming release candidate. We would like to -encourage you to try v1.0.0-rc0 on your test server and to report us -any issues you may encounter. +This release contains numerous bug fixes and other minor improvements +over the Invenio v1.0.0-rc0 release candidate. (Major new features +developed in the meantime will be part of the Invenio v1.1 release +series.) Invenio v1.0.0 is recommended for production to all Invenio +sites using v1.0.0-rc0 or previous v0.99 release series. What's new: ----------- - *) CDS Invenio becomes Invenio as of this release + *) BatchUploader: fix retrieval of recs from extoaiid - *) new facility of hosted collections; support for external records - in search collections, user alerts and baskets (WebSearch, - WebAlert, WebBasket) + *) BibCirculation: fix regexp for dictionary checking; security check + before eval - *) support for nested parentheses in search query syntax (WebSearch) + *) BibConvert: fix UP and DOWN for UTF-8 strings - *) new refersto/citedby search operators for second-order searches in - citation map (BibRank, WebSearch) + *) bibdocfile: add missing normalize_format() calls; + check_bibdoc_authorization caseless; fix append WRT + description/restriction; fix cli_set_batch function; fix + documentation WRT --with-version; fix handling of embargo firerole + rule; fix parsing of complex subformats - *) numerous improvements to SPIRES query syntax parser (WebSearch) + *) BibEdit: fix crash in Ajax request; fix undefined dictionary key - *) enhancement to search results summaries, e.g. co-author lists on - author pages, e.g. h-index (WebSearch) + *) BibFormat: better escape BFE in admin test UI; do not exit if no + XSLT processor found; fix regression test; fix URL to ejournal + resolver; fix XSLT formatting of MARCXML snippets; removes 'No + fulltext' message; special handling of INSPIRE-PUBLIC type; use + default namespace in XSL - *) new support for unAPI, Zotero, OpenSearch, AWS (WebSearch) + *) BibHarvest: check for empty resumptionToken; fix MARCXML creation + in OAI updater; optional JSON dependency - *) new phrase and word-pair indexes (BibIndex) + *) BibIndex: fix author:Campbell-Wilson word query; fix + double-stemming upon indexing; fix Porter stemmer in multithread; + Greek stemmer improvements - *) new fuzzy author name matching mode (BibIndex) + *) BibKnowledge: make XML/XSLT libs optional - *) new time-dependent citation ranking family of methods (BibRank) + *) BibRank: CERN hack to inactivate similarity lists; fix citation + indexer time stamp updating; fix citation indexing of deleted + records; fix citedby/refersto for infinite sets; fix empty + citation data cacher; fix incremental citation indexer leaks; make + numpy optional; minimum x-axis in citation history graphs; run + citation indexer after word indexer - *) full-text search now shows context snippets (BibFormat) + *) BibRecord: fix for record_get_field_instances() - *) improvements to the basket UI, basket export facility (WebBasket) + *) BibSched: fix guess_apache_process_user_from_ps; use larger + timouts for launching tasks - *) new support for FCKeditor in submissions and user comments, - possibility to attach files (WebComment, WebSubmit) + *) BibUpload: FFT regression tests not to use CDS - *) commenting facility enhanced with rounds and threads (WebComment) + *) htmlutils: fix FCKeditor upload URLs - *) new facility to moderate user comments (WebComment) + *) installation: add note about optional hashlib; change table TYPE + to ENGINE in SQL; fix 'install-mathjax-plugin'; fix issue with + FCKeditor; fix 'make install-jquery-plugins'; fix output message + cosmetics; new 'make install-ckeditor-plugin'; re-enable WSGI + pre-loading - *) enhanced CLI tool for document file management bringing new - options such as hidden file flag (WebSubmit) + *) intbitset: fix never ending loop in __repr__; fix several memory + leaks - *) numerous improvements to the submission system, e.g. asynchronous - JavaScript upload support, derived document formats, icon - creation, support for automatic conversion of OpenOffice - documents, PDF/A, OCR (WebSubmit) + *) inveniocfg: fix resetting ranking method names - *) new full-text file metadata reader/writer tool (WebSubmit) + *) inveniogc: new CLI options check/optimise tables - *) new experimental SWORD protocol client application (BibSword) + *) kwalitee: grep-like output and exit status changes; use + `--check-some` as default CLI option - *) complete rewrite of the record editor using Ajax technology for - faster user operation, with new features such as field templates, - cloning, copy/paste, undo/redo, auto-completion, etc (BibEdit) + *) mailutils: remove unnecessary 'multipart/related' - *) new multi-record editor to alter many records in one go (BibEdit) + *) plotextractor: fix INSPIRE unit test - *) new Ajax-based record differ and merger (BibMerge) + *) textmarc2xmlmarc: fix handling of BOM - *) new fuzzy record matching mode, with possibility to match records - against remote Invenio installations (BibMatch) + *) urlutils: new Indico request generator helper - *) new circulation and holdings module (BibCirculation) + *) WebAccess: fix Access policy page; fix FireRole handling integer + uid; fix retrieving emails from firerole - *) new facility for matching provenance information when uploading - records (BibUpload) + *) WebAlert: fix the display of records in alerts - *) new possibility of uploading incoming changes into holding pen - (BibUpload) + *) WebBasket: fix missing return statement; fix number of items in + public baskets - *) new batch uploader facility to support uploading of metadata files - and of full-text files either in CLI or over web (BibUpload) + *) WebComment: CERN-specific hack for ATLAS comments; fix discussion + display in bfe_comments; fix washing of email to admin; improve + sanity checks - *) new record exporting module supporting e.g. Sitemap and Google - Scholar export methods (BibExport) + *) WebHelp: HOWTO MARC document update - *) improvements to the keyword classifier, e.g. author and core - keywords (BibClassify) + *) WebJournal: fix seminar widget encoding issue; fix seminar widget + for new Indico APIs; update weather widget for new APIs - *) new facility for external robot-like login method (WebAccess) + *) WebSearch: add refersto:/a b c/ example to guide; CERN-specific + hack for journal sorting; CERN-specific hack for latest additions; + fix case-insensitive collection search; fix CDSIndico external + search; fix collection translation in admin UI; fix + get_fieldvalues() when recid is str; fix + get_index_id_from_field(); fix structured regexp query parsing; + fix symbol name typo in loop checking; parenthesised collection + definitions; remove accent-search warning in guide; remove Report + for INSPIRE author pages; replace CDS Indico by Indico; updates + some output phrases - *) numerous improvements to the journal creation facility, new - journal `Atlantis Times' demo journal (WebJournal) + *) WebSession: fix crash when no admin user exists - *) refactored and improved OAI exporter and harvester (BibHarvest) + *) WebStyle: better service failure message; fix implementation of + req.get_hostname; fluid width of the menu; pre-load citation + dictionaries for web - *) new taxonomy-based and dynamic-query knowledge base types - (BibKnowledge) + *) WebSubmit: avoid printing empty doctype section; + check_user_can_view_record in publiline; fix filename bug in + document manager; fix handling of uploaded files; fix + record_search_pattern in DEMOJRN - *) possibility to switch on/off user features such as alerts and - baskets based on RBAC rules (WebAccess and other modules) + *) xmlmarclint: 'no valid record detected' error - *) various improvements to task scheduler, for example better - communication with tasks, possibility to run certain bibsched - tasks within given time limit, etc (BibSched) + *) I18N: updates to Catalan, Czech, French, German, Greek, Italian, + Slovak, and Spanish translations - *) new database dumper for backup purposes (MiscUtil) - - *) new plotextractor library for extracting plots from compuscripts, - new figure caption index and the Plots tab (MiscUtil, BibIndex, - Webearch) - - *) enhanced reference extrator, e.g. support for DOI, for author name - recognition (MiscUtil) - - *) new register emergency feature e.g. to alert admins by SMS in case - the task queue stops (MiscUtil) - - *) infrastructure move from mod_python to mod_wsgi, support for - mod_xsendfile (WebStyle and many modules) - - *) infrastructure move from jsMath to MathJax (MiscUtil) - - *) some notable backward-incompatible changes: removed authentication - methods related to Apache user and group files, changed BibFormat - element's API (BibFormat, many modules) - - *) new translations (Afrikaans, Galician, Georgian, Romanian, - Kinyarwanda) plus many translation updates - - *) other numerous improvements and bug fixes done in about 1600 - commits over Invenio v0.99 series + *) Note: for a complete list of new features in Invenio v1.0 release + series over Invenio v0.99 release series, please see: + Download: --------- - - - + + + Installation notes: ------------------- Please follow the INSTALL file bundled in the distribution tarball. Upgrade notes: -------------- -Upgrade from v0.99 series is not recommended for production servers -yet. For test servers, please install an empty Invenio v1.0 series -installation, dump your production tables and load them onto your test -system, and run the usual `make update-v0.99.3-tables' statements -followed by reindexing. More concrete upgrade instructions will be -provided with the final Invenio v1.0.0 release. +If you are upgrading from Invenio v1.0.0-rc0, then: + + - Stop your bibsched queue and your Apache server. + + - Install the update: + + $ cd invenio-1.0.0 + $ cp -a /opt/invenio/etc /opt/invenio/etc.OLD + $ sh /opt/invenio/etc/build/config.nice + $ make + $ make check-custom-templates + $ sudo -u www-data make install + $ sudo -u www-data /opt/invenio/bin/inveniocfg --update-all + $ cp -a /opt/invenio/etc.OLD /opt/invenio/etc + + - In order to apply the double-stemming fix for the indexer, + reindexing of those indexes that use stemming is recommended: + + $ sudo -u www-data bibindex -u admin -R + + - Restart your Apache server and your bibsched queue. You are done. + +If you are upgrading from a previous Invenio release (notably from +v0.99 release series), then please see a dedicated Invenio Upgrade +wiki page at . - end of file - \ No newline at end of file diff --git a/THANKS b/THANKS index 13da2923a..451992b38 100644 --- a/THANKS +++ b/THANKS @@ -1,162 +1,170 @@ Invenio THANKS ============== Several people outside the Invenio Development Team contributed to the project: - Thierry Thomas Patches for compiling old CDSware 0.3.x sources on FreeBSD. - Guido Pelzer Contributions to the German translation. German stopword list. - Valerio Gracco Contributions to the Italian translation. - Tullio Basaglia Contributions to the Italian translation. - Flavio C. Coelho Contributions to the Portuguese translation. - Lyuba Vasilevskaya Contributions to the Russian translation. - Maria Gomez Marti Contributions to the Spanish translation. - Magaly Bascones Dominguez Contributions to the Spanish translation. - Urban Andersson Contributions to the Swedish translation. - Eric Grand Contributions to the French translation. - Theodoropoulos Theodoros Contributions to the Greek translation, Greek stopword list, XML RefWorks output format. - Vasyl Ostrovskyi Contributions to the Ukrainian translation. - Ferran Jorba Contributions to the Catalan and Spanish translations. Cleanup of the old PHP-based BibFormat Admin Guide. Several minor patches. - Beatriu Piera Translation of the Search Guide into Catalan and Spanish. - Anonymous contributor (name withheld by request) Contributions to the Japanese translation. - Anonymous contributor (name withheld by request) Contributions to the Spanish translation. - Alen Vodopijevec Contributions to the Croatian translation. - Jasna Marković Contributions to the Croatian translation. - Kam-ming Ku Contributions to the Chinese translations (zh_CN, zh_TW). - Benedikt Koeppel Contributions to the German translation. - Toru Tsuboyama Contributions to the Japanese translation. - Mike Marino Several minor patches and suggestions. - Zbigniew Szklarz Contributions to the Polish translation. - Iaroslav Gaponenko Contributions to the Russian translation. - Yana Osborne Contributions to the Russian translation. - Zbigniew Leonowicz Contributions to the Polish translation. - Makiko Matsumoto and Takao Ishigaki Contributions to the Japanese translation. - Eva Papp Contributions to the Hungarian translation. - Nino Jejelava Contributions to the Georgian translation. - Cristian Bacchi Improvements to the browse interface. - - Andrey Tremba - Contributions to the Russian translation. + - Andrey Tremba + Contributions to the Russian translation. + + - Cornelia Plott + Contributions to the German translation. The URL handler was inspired by the Quixote Web Framework which is ``Copyright (c) 2004 Corporation for National Research Initiatives; All Rights Reserved''. The session handler was adapted from the mod_python session implementation. Javascript Quicktags scripts from Alex King are used to provide additional capabilities to the edition of BibFormat templates through the web admin interface. The indexer engine uses the Martin Porter Stemming Algorithm and its Vivake Gupta free Python implementation. The CSS style for rounded corners box used in detailed record pages adapted from Francky Lleyneman liquidcorners CSS. The NASA_Subjects.rdf files has been retrieved from the American National Aeronautics and Space Administration (NASA) who kindly provide this for free re-use. The tiger test picure used in automated demo picture submission was converted from Ghostscript's 'tiger.eps'. Some icon images were taken from (i) the Silk icon set, (ii) the Function icon set, and (iii) the activity indicator icon. The unoconv.py script has been adapted from UNOCONV by Dag Wieers. PDFA_def.ps has been adapted from the GPL distribution of GhostScript. The ISOCoatedsb.icc ICC profile has been retrieved from the European Color Initiative. -The PEP8 conformance checking script (pep8.py) was written by Johann -C. Rocholl . The pep8.py version included -with Invenio was downloaded from +The PEP8 conformance checking script (pep8.py) was written by +Johann C. Rocholl . +The pep8.py version included with Invenio was downloaded from on 2009-06-14. +The logicutils library was originally authored by +Peter Norvig and was taken from + on 2010-05-20 and later expanded +to fit Invenio needs. + The asyncproc module to manage asynchronous processes with timeout support was written by Thomas Bellman . The asyncproc.py version included with Invenio was downloaded from on 2009-07-13. The git-version-gen script was taken from gnulib 20100704+stable-1. - end of file -