Email updates

Keep up to date with the latest news and content from GigaScience and BioMed Central.

Open Access Technical Note

AXIOME: automated exploration of microbial diversity

Michael DJ Lynch, Andre P Masella, Michael W Hall, Andrea K Bartram and Josh D Neufeld*

Author Affiliations

Department of Biology, University of Waterloo, 200 University Avenue West, Waterloo, Ontario, N2L 3G1, Canada

For all author emails, please log on.

GigaScience 2013, 2:3  doi:10.1186/2047-217X-2-3

The electronic version of this article is the complete one and can be found online at: http://www.gigasciencejournal.com/content/2/1/3


Received:22 November 2012
Accepted:4 March 2013
Published:13 March 2013

© 2013 Lynch et al.; licensee BioMed Central Ltd.

This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Abstract

Background

Although high-throughput sequencing of small subunit rRNA genes has revolutionized our understanding of microbial ecosystems, these technologies generate data at depths that benefit from automated analysis. Here we present AXIOME (Automation, eXtension, and Integration Of Microbial Ecology), a highly flexible and extensible management tool for popular microbial ecology analysis packages that promotes reproducibility and customization in microbial research.

Findings

AXIOME streamlines and manages analysis of small subunit (SSU) rRNA marker data in QIIME and mothur. AXIOME also implements features including the PAired-eND Assembler for Illumina sequences (PANDAseq), non-negative matrix factorization (NMF), multi-response permutation procedures (MRPP), exploring and recovering phylogenetic novelty (SSUnique) and indicator species analysis. AXIOME has a companion graphical user interface (GUI) and is designed to be easily extended to facilitate customized research workflows.

Conclusions

AXIOME is an actively developed, open source project written in Vala and available from GitHub (http://neufeld.github.com/axiome webcite) and as a Debian package. Axiometic, a GUI companion tool is also freely available (http://neufeld.github.com/axiometic webcite). Given that data analysis has become an important bottleneck for microbial ecology studies, the development of user-friendly computational tools remains a high priority. AXIOME represents an important step in this direction by automating multi-step bioinformatic analyses and enabling the customization of procedures to suit the diverse research needs of the microbial ecology community.

Keywords:
Microbial ecology; Automation; SSU rRNA; High-throughput sequencing; QIIME; mothur

Findings

Rationale

Next-generation sequencing technologies have improved our ability to study complex microbial communities, but have also posed significant computational challenges associated with analyzing such large sequence datasets. The research community has developed multiple analysis platforms [1-4] to manage analysis of taxonomic high-throughput sequencing data, particularly for the study of microbial small subunit (SSU) rRNA sequence data. As implemented, these pipelines require extensive user intervention and are not particularly well suited to extension. To address these issues, we developed the Automation, eXtension, and Integration Of Microbial Ecology (AXIOME) package and the associated graphical user interface, Axiometic. AXIOME simplifies analyses common to native installs of multiple analysis platforms by using XML scripting and configuration. Generating AXIOME’s XML input using Axiometic, the companion GUI, simplifies scripting and further increases usability. AXIOME also extends functionality by offering several additional analytical plug-ins and easily enables the implementation of user-specific functionality for customized workflows.

Functionality

Automation and checkpointing and reproducible research

Analysis environments, such as QIIME and mothur, have provided open source and effective tools for the analysis of high-throughput marker sequencing data (e.g., SSU rRNA). These environments are not easily automated beyond shell scripting, which is available for essentially any software installed on a Unix/Linux-based operating system. While effective, shell scripting can present a significant barrier to researchers using the software. AXIOME avoids this difficulty by interpreting commands from an XML-based input file containing simplified instructions and analysis blocks. This XML-based configuration file can be created manually, from workflow templates, or using the simple and interactive GUI tool, Axiometic.

Analysis pipelines for high-throughput marker data can consume many CPU hours due to dataset size and analysis complexity. Workflows can be interrupted for a myriad of reasons, including power failure and software error. Furthermore, analytical parameters can be modified or analyses added based on preliminary results. Built into AXIOME, using the make software package, is the ability to automatically restart a workflow from the last valid position, which does not unnecessarily reproduce previous valid results. This behavior can significantly reduce computational load and errors caused by excessive user intervention.

Efforts such as metadata standardization [5] and bioinformatic tools stressing reproducibility [6,7] represent attempts to make bioinformatic workflows documented and reproducible, thus facilitating collaboration. The use of XML-based instructions defining an entire AXIOME workflow has the added benefit of contributing to these reproducible research initiatives. This is a useful addition to both individual researchers and to the collaboration of different investigators, and can be packaged with research publications.

Extension

AXIOME manages QIIME [2] analyses and supports sequence processing and α-diversity in mothur [1]. In addition to offering common α- and β-diversity measures, there are several functions specific to AXIOME v.1.6. AXIOME enables the assembly and de-multiplexing of Illumina paired-end reads through the use of PAired-eND Assembler for Illumina sequences (PANDAseq [8]). Post-assembly analysis techniques unique to AXIOME include (i) non-negative matrix factorization [9], a technique that identifies overlapping patterns between samples, generating a concordance model, that can then be used for a non-negative factorization of the sample matrix (used to visualize the importance of specific taxa within a sample or a cluster of samples), (ii) multi-response permutation procedures (MRPP [10]), which tests for significant differences between sampling groups and the degree of within-group sample clustering, (iii) recovering and exploring phylogenetic novelty (SSUnique [11]) and (iv) indicator species analysis [12], a method for identifying operational taxonomic units (OTUs) that are significantly associated with user-defined sample treatment groups. Future releases of AXIOME will continue to incorporate analysis techniques reflecting advances in the analysis of marker data in ecology.

One advantage of the AXIOME package is the ability to quickly extend functionality to include new protocols, easily customizing research workflows. This also provides the opportunity to test alternative approaches to sequence analysis before implementing them in standard distributions of software environments, such as QIIME or mothur. In AXIOME, individual analyses are managed through the corresponding XML tag within the configuration file, and custom XML tags that invoke novel analyses can be built into the source to extend AXIOME. Full instructions and templates for extension are provided with the source and documentation. By facilitating extension of analysis pipelines, the implementation of previously existing ecological methods and the development of novel techniques can progress at a faster rate than through standard release schedules. This will foster experimentation and increase community involvement in these efforts.

AXIOME workflow

All user-defined workflow analyses and parameters are outlined in a single XML configuration file, which is processed by AXIOME, generating a Makefile that controls and manages analyses. By leveraging these tools, an entire run of QIIME and all requested extensions requires only three steps (Figure 1). Additionally, any interruption in processing can be circumvented by re-running the make command, which will act as a checkpoint by restarting from the last valid position. Furthermore, a companion GUI, Axiometic (Figure 2), allows users to easily construct this XML configuration file. Even though AXIOME is designed to work within a Linux environment, the XML configuration file can be generated on any system and transferred to the analysis environment. Axiometic is based on a platform-independent toolkit, further facilitating XML script generation.

thumbnailFigure 1. Schematic representation of the AXIOME workflow and its relation to existing QIIME analyses.

thumbnailFigure 2. Axiometic, a multi-platform companion GUI for AXIOME with four steps defining: metadata associated with samples, the data source files, expressions for sorting samples within source file and the analyses for the AXIOME pipeline to run. The resulting XML control file is interpreted by AXIOME to run analyses. Axiometic is available for Linux, Windows and is in development for Mac OS X.

Distributed with the source is a sample analysis, including instructions, XML workflow script, data files and expected output. The workflow management of AXIOME fosters reproducible, predictable and automated analyses, which are challenging goals given the large sequence datasets now being generated. AXIOME adds to the expanding computational toolbox supporting the next generation of research efforts in microbial ecology.

Comparison to related work

The Galaxy project [7,13,14] is a web-based analysis management and distribution system for biomedical research. Currently, analysis of SSU rRNA marker data within Galaxy can be accomplished through a mothur v.1.27.0 [1] implementation. Additionally, a QIIME [2] wrapper (QIIME-Galaxy) is under development for Galaxy. Within Galaxy, these implementations are intended to provide a managed workflow, either locally or within the cloud, which will be a suitable solution for many researchers. Besides analysis techniques specific to AXIOME, our software offers some features not present in either Galaxy-associated packages. For example, AXIOME uses a package manager, greatly simplifying installation (apt-get install). Furthermore, AXIOME excels at local management and extension of marker gene workflows with modular XML scripting and checkpointing, allowing for rapid exploration of parameter and analysis modifications. When marker gene workflows are more fully integrated into Galaxy, we envision AXIOME as a complementary system for workflow management and extension. To actively contribute to the open source analysis community, we are in the process of contributing to Galaxy the various analysis routines specific to AXIOME (Figure 1).

Availability of AXIOME

AXIOME is an actively developed, open source project written in Vala and available from GitHub (http://neufeld.github.com/axiome webcite) and also as a Debian package, serving as a companion to any native QIIME (v.1.4 and above) or mothur install. Specific details of the design and implementation of AXIOME are packaged with the source, including detailed explanations of tool development and the relationship between files in the repository. Axiometic, a GUI companion tool for easily generating AXIOME XML analysis instructions, is also freely available (http://neufeld.github.com/axiometic webcite). AXIOME is compatible with the .biom universal data file format [15] and was designed to work within a Linux environment, including suitable cloud-computing infrastructures such as Amazon EC2. A comprehensive manual, dependencies list, tutorial and sample data are also provided.

Given that data analysis has become an important bottleneck for the effectiveness of microbial ecology studies, the development of user-friendly computational tools remains a high priority. AXIOME represents an important step in this direction by automating multi-step bioinformatic analyses and enabling the customization of procedures to suit the diverse research needs of the microbial ecology community.

Availability and requirements

Project name: AXIOME, Axiometic

Project home page:http://neufeld.github.com/axiome webcite, http://neufeld.github.com/axiometic webcite

Operating system: Linux (AXIOME), Platform independent (Axiometic)

Programming language: C, Vala, R, Python

Other requirements: QIIME (and dependencies therein), make, awk, mothur (optional), PANDAseq (optional); see documentation for a comprehensive list of optional dependencies, based on workflow requirements.

License: GPL v3

Any restrictions to use by non-academics: No

Abbreviations

AXIOME: Automation, eXtension, and Integration Of Microbial Ecology; CPU: Central processing unit; GUI: Graphical user interface; MRPP: Multi-response permutation procedures; NMF: Non-negative matrix factorization; OTU: Operational taxonomic unit; PANDAseq: PAired-eND assembler for Illumina sequences; QIIME: Quantitative insights into microbial ecology; SSU: Small subunit

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

MDJL contributed to the design of AXIOME and manuscript preparation. APM designed and implemented AXIOME. MWH contributed to AXIOME and implemented Axiometic. AKB contributed to testing of AXIOME. JDN contributed to the design and coordination of the project, testing of AXIOME and manuscript preparation. All authors read and approved the final manuscript.

Acknowledgements

This work was funded by the Canadian Institutes of Health Research (CIHR) and both Strategic Project and Discovery Grants from the Natural Sciences and Engineering Research Council of Canada (NSERC).

References

  1. Schloss PD, Westcott SL, Ryabin T, Hall JR, Hartmann M, Hollister EB, Lesniewski RA, Oakley BB, Parks DH, Robinson CJ, Sahl JW, Stres B, Thallinger GC, Van Horn DJ, Weber CF: Introducing mothur: open-source, platform-independent, community-supported software for describing and comparing microbial communities.

    Appl Environ Microbiol 2009, 75:7537-7541. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  2. Caporaso JG, Kuczynski J, Stombaugh J, Bittinger K, Bushman FD, Costello EK, Fierer N, Peña AG, Goodrich JK, Gordon JI, Huttley GA, Kelley ST, Knights D, Koenig JE, Ley RE, Lozupone CA, McDonald D, Muegge BD, Pirrung M, Reeder J, Sevinsky JR, Turnbaugh PJ, Walters WA, Widmann J, Yatsunenko T, Zaneveld J, Knight R: QIIME allows analysis of high-throughput community sequencing data.

    Nat Methods 2010, 7:335-336. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  3. Giongo A, Crabb DB, Davis-Richardson AG, Chauliac D, Mobberley JM, Gano KA, Mukherjee N, Casella G, Roesch LF, Walts B, Riva A, King G, Triplett EW: PANGEA: pipeline for analysis of next generation amplicons.

    ISME J 2010, 4:852-861. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  4. McMurdie PJ, Holmes SP: phyloseq: A Bioconductor package for handling and analysis of high-throughput phylogenetic sequence data.

    Pac Symp Biocomput 2012, 17:235-246. OpenURL

  5. Yilmaz P, Kottmann R, Field D, Knight R, Cole JR, Amaral-Zettler L, Gilbert JA, Karsch-Mizrachi I, Johnston A, Cochrane G, Vaughan R, Hunter C, Park J, Morrison N, Rocca-Serra P, Sterk P, Arumugam M, Bailey M, Baumgartner L, Birren BW, Blaser MJ, Bonazzi V, Booth T, Bork P, Bushman FD, Buttigieg PL, Chain PS, Charlson E, Costello EK, Huot-Creasy H: Minimum information about a marker gene sequence (MIMARKS) and minimum information about any (x) sequence (MixS) specifications.

    Nat Biotechnol 2011, 29:415-420. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  6. Gentleman RC, Carey VJ, Bates DM, Bolstad B, Dettling M, Dudoit S, Ellis B, Gautier L, Ge Y, Gentry J, Hornik K, Hothorn T, Huber W, Iacus S, Irizarry R, Leisch F, Li C, Maechler M, Rossini AJ, Sawitzki G, Smith C, Smyth G, Tierney L, Yang JY, Zhang J: Bioconductor: open software development for computational biology and bioinformatics.

    Genome Biol 2004, 5:R80. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  7. Goecks J, Nekrutenko A, Taylor J, The Galaxy Team: Galaxy: a comprehensive approach for supporting accessible, reproducible, and transparent computational research in the life sciences.

    Genome Biol 2010, 11:R86. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  8. Masella AP, Bartram AK, Truszkowski JM, Brown DG, Neufeld JD: PANDAseq: paired-end assembler for Illumina sequences.

    BMC Bioinformatics 2012, 13:31. PubMed Abstract | BioMed Central Full Text | PubMed Central Full Text OpenURL

  9. Jiang X, Weitz JS, Dushoff J: A non-negative matrix factorization framework for identifying modular patterns in metagenomic profile data.

    J Math Biol 2012, 64:697-711. PubMed Abstract | Publisher Full Text OpenURL

  10. Mielke PW Jr: Meteorological applications of permutation techniques based on distance functions. In Handbook of Statistics, Volume 4: Nonparametric Methods. Edited by Krishnaiah P, Sen P. Amsterdam: Elsevier; 1984:813-830. OpenURL

  11. Lynch MDJ, Bartram AK, Neufeld JD: Targeted recovery of novel phylogenetic diversity from next-generation sequence data.

    ISME J 2012, 6:2067-2077. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  12. Dufrêne M, Legendre P: Species assemblages and indicator species: the need for a flexible asymmetrical approach.

    Ecol Monogr 1997, 67:345-366. OpenURL

  13. Blankenberg D, Von Kuster G, Coraor N, Ananda G, Lazarus R, Mangan M, Nekrutenko A, Taylor J: Galaxy: a web-based genome analysis tool for experimentalists.

    Curr Protoc Mol Biol 2010, 89:19.10.1-19.10.21. OpenURL

  14. Giardine B, Riemer C, Hardison RC, Burhans R, Elnitski L, Shah P, Zhang Y, Blankenberg D, Albert I, Taylor J, Miller W, Kent WJ, Nekrutenko A: Galaxy: a platform for interactive large-scale genome analysis.

    Genome Res 2005, 15:1451-1455. PubMed Abstract | Publisher Full Text | PubMed Central Full Text OpenURL

  15. McDonald M, Clemente JC, Kuczynski J, Rideout JR, Stombaugh J, Wendel D, Wilke A, Huse S, Hufnagle J, Meyer F, Knight R, Caporaso JG: The Biological Observation Matrix (BIOM) format or: how I learned to stop worrying and love the ome-ome.

    GigaScience 2012, 1:7. OpenURL