Name: cloud-based phrase mining and analysis of user-defined phrase-category association in biomedical publications
Uploaded: 2019-02-23T14:00:00
Duration: 9 min 20 s
Description: Watch this Scientific Journal Video about Cloud-Based Phrase Mining and Analysis of User-Defined Phrase-Category Association in Biomedical Publications at JoVE.com

This work was supported in part by National Heart, Lung, and Blood Institute: R35 HL135772 (to P. Ping); National Institute of General Medical Sciences: U54 GM114833 (to P. Ping, K. Watson, and W. Wang); U54 GM114838 (to J. Han); a gift from the Hellen &#38; Larry Hoag Foundation and Dr. S. Setty; and the T.C. Laubisch endowment at UCLA (to P. Ping).

NOTE: We have developed this protocol based on the Python programming language. To run this program, have Anaconda Python and Git pre-installed on the device. The commands provided in this protocol are based on Unix environment. This protocol provides the detail of downloading data from PubMed (MEDLINE) database, parsing the data, and setting up a cloud computing platform for the phrase mining and quantification of user-defined entity-category association.
1.Getting code and python environment setup
<ol>
	<li>Download or clone the code repository from Github (<a href="https://github.com/CaseOLAP/caseolap.git">https://github.com/CaseOLAP/caseolap</a>) or by typing &#8216;git clone <a href="https://github.com/CaseOLAP/caseolap.git">https://github.com/CaseOLAP/caseolap.git</a>&#8217; in the terminal window.</li>
	<li>Navigate to the &#8216;caseolap&#8217; directory. This is the root directory of the project. Within this directory, the &#8216;data&#8217; directory will be populated with multiple data sets as you progress through these steps in the protocol. The &#8216;input&#8217; directory is for user-provided data. The &#8216;log&#8217; directory has log files for troubleshooting purposes. The &#8216;result&#8217; directory is where the final results will be stored.</li>
	<li>Using the terminal window, go to the directory where you cloned our GitHub repository. Create the CaseOLAP environment using the &#8216;environment.yml&#8217; file by typing &#8216;conda env create -f environment.yaml&#8217; in the terminal. Then activate the environment by typing &#8216;source activate caseolap&#8217; in the terminal.</li>
</ol>
2. Downloading documents
<ol>
	<li>Make sure that the FTP address in &#8216;ftp_configuration.json&#8217; in the config directory is the same as the Annual Baseline or Daily Update Files link address, found in the link (<a href="https://www.nlm.nih.gov/databases/download/pubmed_medline.html">https://www.nlm.nih.gov/databases/download/pubmed_medline.html</a>).</li>
	<li>To download baseline only or update files only, set &#8216;true&#8217; in the &#8216;download_config.json&#8217; file in the &#8216;config&#8217; directory. By default, it downloads and extracts both baseline and update files. A sample of extracted XML data can be viewed at (<a href="https://github.com/CaseOLAP/caseolap-pipelines/blob/master/data/extracted-data-sample.xml">https://github.com/CaseOLAP/caseolap-pipelines/blob/master/data/extracted-data-sample.xml</a>)</li>
	<li>Type &#8216;python run_download.py&#8217; in the terminal window to download abstracts from the Pubmed database. This will create a directory called &#8216;ftp.ncbi.nlm.nih.gov&#8217; in the current directory. This process checks the integrity of the downloaded data and extracts it to the target directory.</li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;download_log.txt&#8217; in case the download process fails. If the process is completed successfully, the debugging messages of the download process will be printed out in this log file.</li>
	<li>When the download is complete, navigate through &#8216;ftp.ncbi.nlm.nih.gov&#8217; to make sure that there is &#8216;updatefiles&#8217; or &#8216;basefiles&#8217; or both directories based on download configuration in &#8216;download_config.json&#8217;. The file statistics become available at &#8216;filestat.txt&#8217; in the &#8216;data&#8217; directory.</li>
</ol>
3. Parsing documents
<ol>
	<li>Make sure that downloaded and extracted data is available at &#8216;ftp.ncbi.nlm.nih.gov&#8217; directory from step 2. This directory is the input data directory in this step.</li>
	<li>To modify the data-parsing schema, select parameters in &#8216;parsing_config.json&#8217; file in the &#8216;config&#8217; directory by setting their value to &#8216;true&#8217;. By default, it parses the PMID, authors, abstract, MeSH, location, journal, publication date.</li>
	<li>Type &#8216;python run_parsing.py&#8217; in the terminal to parse the documents from downloaded (or extracted) files. This step parses all downloaded XML files and creates a python dictionary for each document with keys (e.g., PMID, authors, abstract, MeSH of the file based on parsing schema setup at step 3.2).</li>
	<li>Once data parsing is completed, make sure that parsed data is saved in the file called &#8216;pubmed.json&#8217; in the data directory. A sample of parsed data is available at Figure 3.</li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;parsing_log.txt&#8217; in case the parsing process fails. If the process is completed successfully, the debugging messages will be printed out in the log file.</li>
</ol>
4. Mesh to PMID mapping
<ol>
	<li>Make sure that parsed data (&#8216;pubmed.json&#8217;) is available at the &#8216;data&#8217; directory.</li>
	<li>Type &#8216;python run_mesh2pmid.py&#8217; in the terminal to perform MeSH to PMID mapping. This creates a mapping table where each of the MeSH collects associated PMIDs. A Single PMID may fall under the multiple MeSH terms.</li>
	<li>Once the mapping is completed, make sure that there is &#8216;mesh2pmid.json&#8217; in the data directory. A sample of the top 20 mapping statistics is available in Table-2, Figures 4 and 5.</li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;mesh2pmid_mapping_log.txt&#8217; in case this process fails. If the process is completed successfully, the debugging messages of the mapping will be printed out in this log file.</li>
</ol>
5. Document indexing
<ol>
	<li>Download the Elasticsearch application from <a href="https://www.elastic.co/downloads">https://www.elastic.co</a>. Currently, the download is available at (<a href="https://www.elastic.co/downloads/elasticsearch">https://www.elastic.co/downloads/elasticsearch</a>). To download the software in the remote cloud, type &#8216;wget <a href="https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-x.x.x.tar.gz">https://artifacts.elastic.co/downloads/elasticsearch/elasticsearch-x.x.x.tar.gz</a>&#8217; in the terminal. Make sure that &#8216;x.x.x&#8217; in the above command is replaced by proper version number.</li>
	<li>Make sure that downloaded &#8216;elasticsearch-x.x.x.tar.gz&#8217; file appears in the root directory then extract the files by typing &#8216;tar xvzf elasticsearch-x.x.x.tar.gz&#8217; in the terminal window.</li>
	<li>Open a new terminal and go to the ElasticSearch bin directory by typing &#8216;cd Elasticsearch/bin&#8217; in the terminal from the root directory.</li>
	<li>Start the Elasticsearch server by typing &#8216;./Elasticsearch&#8217; in the terminal window. Make sure that the server is started without error messages. In case of error on starting Elasticsearch server, follow the instructions at (<a href="https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html">https://www.elastic.co/guide/en/elasticsearch/reference/current/index.html</a>).</li>
	<li>Modify the contents in the &#8216;index_init_config.json&#8217; in &#8216;config&#8217; directory to set index initiation. By default, it will select all items present.</li>
	<li>Type &#8216;python run_index_init.py&#8217; in the terminal to initiate an index-database in the Elasticsearch server. This initializes the index with a set of criteria known as index information (e.g., index name, type name, number of shards, number of replicas). You will see the message mentioning index is successfully created.</li>
	<li>Select the items in the &#8216;index_populate_config.json&#8217; in the &#8216;config&#8217; directory by setting their value to &#8216;true&#8217;. By default, it will select all items present.</li>
	<li>Make sure that parsed data (&#8216;pubmed.json&#8217;) is present in the &#8216;data&#8217; directory.</li>
	<li>Type &#8216;python run_index_populate.py&#8217; in the terminal to populate the index by creating bulk data with two components.A first component is a dictionary with metadata information on the index name, type name, and bulk id (e.g., &#8216;PMID&#8217;). A second component is a data dictionary containing all the information on the tags (e.g., &#8216;title&#8217;,&#8217;abstract&#8217;,&#8217;MeSH&#8217;). </li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;indexing_log.txt&#8217; in case this process fails. If the process is completed successfully, the debugging messages of the indexing will be printed out in the log file.</li>
</ol>
6. Text-cube creation
<ol>
	<li>Download the latest MeSH Tree available at (<a href="https://www.nlm.nih.gov/mesh/filelist.html">https://www.nlm.nih.gov/mesh/filelist.html</a>). The current version of the code is using MeSH Tree 2018 as &#8216;meshtree2018.bin&#8217; in the input directory.</li>
	<li>Define the categories of interest (e.g., Disease names, Age groups, Gender). A category may include one or more MeSH descriptors (<a href="https://meshb-prev.nlm.nih.gov/treeView">https://meshb-prev.nlm.nih.gov/treeView</a>). Collect MeSH IDs for a category. Save the names of the categories in the file &#8216;textcube_config.json&#8217; in the config directory (see a sample of the category in &#8216;Age Group&#8217; in the downloaded version of &#8216;textcube_config.json&#8217; file).</li>
	<li>Put the collected categories of MeSH IDs in a line separated by a space. Save the category file as &#8216;categories.txt&#8217; in the &#8216;input&#8217; directory (see a sample of &#8216;Age Group&#8217; MeSH IDs in the downloaded version of &#8216;categories.txt&#8217; file). This algorithm automatically selects all descendent MeSH descriptors. An example of root nodes and descendants are presented in Figure 4.</li>
	<li>Make sure that &#8216;mesh2pmid.json&#8217; is in the &#8216;data&#8217; directory. If the MeSH Tree has been updated with a different name (e.g., &#8216;meashtree2019.bin&#8217;) in &#8216;input&#8217; directory, make sure that this is properly represented in the input data path in the &#8216;run_textube.py&#8217; file.</li>
	<li>Type &#8216;python run_textcube.py&#8217; in the terminal to create a document data structure called Text-Cube. This creates a collection of documents (PMIDs) for each category. A single document (PMID) may fall under multiple categories, (see Table 3A, Table 3B, Figure 6A and Figure 7A).</li>
	<li>Once Text-Cube creation step is completed, make sure that following data files are saved in the &#8216;data&#8217; directory: (1) a cell to PMID table as &#8220;textcube_cell2pmid.json&#8221;, (2) a PMID to cell mapping table as &#8220;textcube_pmid2cell.json&#8221;, (3) a collection of all descendant MeSH terms for a cell as &#8220;meshterms_per_cat.json&#8221; (4) Text-Cube data statistics as &#8220;textcube_stat.txt&#8221;.</li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;textcube_log.txt&#8217; in case this process fails. If the process is completed successfully, the debugging messages of the Text-Cube creation will be printed out in the log file.</li>
</ol>
7. Entity count
<ol>
	<li>Create user-defined entities (e.g., protein names, genes, chemicals). Put one entity and its abbreviations in a single line separated by &#8220;|&#8221;. Save the entity file as &#8216;entities.txt&#8217; in the &#8216;input&#8217; directory. A sample of entities can be found in Table 4.</li>
	<li>Make sure that Elasticsearch server is running. Otherwise, go to step 5.2 and 5.3 to restart the Elasticsearch server. It is expected to have an indexed database called &#8216;pubmed&#8217; in your Elasticsearch server which was established in step 5.</li>
	<li>Make sure that &#8216;textcube_pmid2cell.json&#8217; is in the &#8216;data&#8217; directory.</li>
	<li>Type &#8216;python run_entitycount.py&#8217; in the terminal to perform Entity Count operation. This searches the documents from the indexed database and counts the entity in each document as well as collects the PMIDs in which entities were found.</li>
	<li>Once the Entity Count is completed, make sure that the final results are saved as &#8216;entitycount.txt&#8217; and &#8216;entityfound_pmid2cell.json&#8217; in the &#8216;data&#8217; directory.</li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;entitycount_log.txt&#8217; in case this process fails. If the process is completed successfully, the debugging messages of the Entity Count will be printed out in the log file.</li>
</ol>
8. Metadata update
<ol>
	<li>Make sure that all input data (&#8216;entitycount.txt&#8217;, &#8216;textcube_pmid2cell.json&#8217;, &#8216;entityfound_pmid2cell.txt&#8217;) are in the &#8216;data&#8217; directory. These are the input data for Metadata Update.</li>
	<li>Type &#8216;python run_metadata_update.py&#8217; in the terminal to update the metadata. This prepares a collection of metadata (e.g., cell name, associated MeSH, PMIDs) representing each text document in the cell. A sample of Text-Cube metadata is presented in Table 3A and Table 3B.</li>
	<li>Once the Metadata Update is completed, make sure that &#8216;metadata_pmid2pcount.json&#8217; and &#8216;metadata_cell2pmid.json&#8217; files are saved in &#8216;data&#8217; directory.</li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;metadata_update_log.txt&#8217; in case this process fails. If the process is completed successfully, the debugging messages of the metadata update will be printed out in the log file.</li>
</ol>
9. CaseOLAP score calculation
<ol>
	<li>Make sure that &#8216;metadata_pmid2pcount.json&#8217; and &#8216;metadata_cell2pmid.json&#8217; files are present in the &#8216;data&#8217; directory. These are the input data for score calculation.</li>
	<li>Type &#8216;python run_caseolap_score.py&#8217; in the terminal to perform CaseOLAP score calculation. This calculates the CaseOLAP score of the entities based on user-defined categories. The CaseOLAP score is the product of Integrity, Popularity, and Distinctiveness.</li>
	<li>Once the score computation is completed, make sure that this saves the results in multiple files (e.g., popularity as &#8216;pop.csv&#8217;, distinctiveness as &#8216;dist.csv&#8217;, CaseOLAP score as &#8217;caseolap.csv&#8217;), in the &#8216;result&#8217; directory. The summary of the CaseOLAP score calculation is also presented in Table 5.</li>
	<li>Go to the &#8216;log&#8217; directory to read the log messages in &#8216;caseolap_score_log.txt&#8217; in case this process fails. If the process is completed successfully, the debugging messages of the CaseOLAP score calculation will be printed out in the log file.</li>
</ol>

<ol>
	<li>Tao, F., Zhuang, H., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phrase-Based+Summarization+in+Text+Cubes.">Phrase-Based Summarization in Text Cubes.</a> IEEE Data Engineering Bulletin. , 74-84 (2016).</li><li>Ding, B., Zhao, B., Lin, C. X., Han, J., Zhai, C. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=TopCells:+Keyword-based+search+of+top-k+aggregated+documents+in+text+cube.">TopCells: Keyword-based search of top-k aggregated documents in text cube.</a> IEEE 26th International Conference on Data Engineering (ICDE). , 381-384 (2010).</li><li>Ding, B., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Efficient+Keyword-Based+Search+for+Top-K+Cells+in+Text+Cube.">Efficient Keyword-Based Search for Top-K Cells in Text Cube.</a> IEEE Transactions on Knowledge and Data Engineering. 23 (12), 1795-1810 (2011).</li><li>Liu, X., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+Text+Cube+Approach+to+Human,+Social+and+Cultural+Behavior+in+the+Twitter+Stream.Social+Computing,+Behavioral-Cultural+Modeling+and+Prediction.">A Text Cube Approach to Human, Social and Cultural Behavior in the Twitter Stream.Social Computing, Behavioral-Cultural Modeling and Prediction.</a> Lecture Notes in Computer Science. 7812, (2013).</li><li>Liem, D. A., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Phrase+Mining+of+Textual+Data+to+analyze+extracellular+matrix+protein+patterns+across+cardiovascular+disease.">Phrase Mining of Textual Data to analyze extracellular matrix protein patterns across cardiovascular disease.</a> American Journal of Physiology-Heart and Circulatory. , (2018).</li><li>Shang, J., et al. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Automated+Phrase+Mining+from+Massive+Text+Corpora.">Automated Phrase Mining from Massive Text Corpora.</a> IEEE Transactions on Knowledge and Data Engineering. 30 (10), 1825-1837 (2018).</li><li>Liu, J., Shang, J., Wang, C., Ren, X., Han, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Mining+Quality+Phrases+from+Massive+Text+Corpora.">Mining Quality Phrases from Massive Text Corpora.</a> Proceedings ACM-Sigmod International Conference on Management of Data. , 1729-1744 (2015).</li><li>Lee, S., Kim, N., Kim, J. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+Multi-dimensional+Analysis+and+Data+Cube+for+Unstructured+Text+and+Social+Media.">A Multi-dimensional Analysis and Data Cube for Unstructured Text and Social Media.</a> IEEE Fourth International Conference on Big Data and Cloud Computing. , 761-764 (2014).</li><li>Lin, C. X., Ding, B., Han, J., Zhu, F., Zhao, B. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Text+Cube:+Computing+IR+Measures+for+Multidimensional+Text+Database+Analysis.">Text Cube: Computing IR Measures for Multidimensional Text Database Analysis.</a> IEEE Data Mining. , 905-910 (2008).</li><li>Hsu, W. J., Lu, Y., Lee, Z. Q. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Accelerating+Topic+Exploration+of+Multi-Dimensional+Documents+Parallel+and+Distributed+Processing+Symposium+Workshops+(IPDPSW).">Accelerating Topic Exploration of Multi-Dimensional Documents Parallel and Distributed Processing Symposium Workshops (IPDPSW).</a> IEEE International. , 1520-1527 (2017).</li><li>Chaudhuri, S., Dayal, U. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=An+overview+of+data+warehousing+and+OLAP+technology.">An overview of data warehousing and OLAP technology.</a> SIGMOD Record. 26 (1), 65-74 (1997).</li><li>Ravat, F., Teste, O., Tournier, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Olap+aggregation+function+for+textual+data+warehouse.">Olap aggregation function for textual data warehouse.</a> ICEIS - 9th International Conference on Enterprise Information Systems, Proceedings. , 151-156 (2007).</li><li>Ho, C. T., Agrawal, R., Megiddo, N., Srikant, R. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Range+Queries+in+OLAP+Data+Cubes.">Range Queries in OLAP Data Cubes.</a> SIGMOD Conference. , (1997).</li><li>Saxena, V., Pratap, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Olap+Cube+Representation+for+Object-+Oriented+Database.">Olap Cube Representation for Object- Oriented Database.</a> International Journal of Software Engineering &amp; Applications. 3 (2), (2012).</li><li>Maniatis, A. S., Vassiliadis, P., Skiadopoulos, S., Vassiliou, Y. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Advanced+visualization+for+OLAP.">Advanced visualization for OLAP.</a> DOLAP. , (2003).</li><li>Bog, A. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=.">.</a> Benchmarking Transaction and Analytical Processing Systems: The Creation of a Mixed Workload Benchmark and its Application. , 7-13 (2013).</li><li>&#214;zcan, F., Tian, Y., T&#246;z&#252;n, P. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Hybrid+Transactional/Analytical+Processing:+A+Survey.">Hybrid Transactional/Analytical Processing: A Survey.</a> In Proceedings of the ACM International Conference on Management of Data (SIGMOD). , 1771-1775 (2017).</li><li>Hasan, K. M. A., Tsuji, T., Higuchi, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=An+Efficient+Implementation+for+MOLAP+Basic+Data+Structure+and+Its+Evaluation.">An Efficient Implementation for MOLAP Basic Data Structure and Its Evaluation.</a> International Conference on Database Systems for Advanced Applications. , 288-299 (2007).</li><li>Nantajeewarawat, E. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=Advances+in+Databases:+Concepts,+Systems+and+Applications.+DASFAA+2007.">Advances in Databases: Concepts, Systems and Applications. DASFAA 2007.</a> Lecture Notes in Computer Science. 4443, (2007).</li><li>Shimada, T., Tsuji, T., Higuchi, K. <a target="_blank" href="http://www.ncbi.nlm.nih.gov/entrez/query.fcgi?db=PubMed&cmd=Search&doptcmdl=Citation&defaultField=Title+Word&term=A+storage+scheme+for+multidimensional+data+alleviating+dimension+dependency.">A storage scheme for multidimensional data alleviating dimension dependency.</a> Third International Conference on Digital Information Management. , 662-668 (2007).</li></ol>

The authors have nothing to disclose.

We have demonstrated that the CaseOLAP algorithm can create a phrase based quantitative association to a knowledge-based category over large volumes of textual data for extraction of meaningful insights. Following our protocol, one can build the CaseOLAP framework to create a desired Text-Cube and quantify entity-category associations through CaseOLAP score calculation. The obtained raw CaseOLAP scores can be taken to integrative analyses including dimensionality reduction, clustering, temporal and geographical analysis, as well as the creation of a graphical database which enables semantic mapping of the documents.
Applicability of the algorithm. Examples of user-defined entities, other than proteins, could be a list of gene names, drugs, specific signs and symptoms including their abbreviations and synonyms. Furthermore, there are many choices for category selection to facilitate specific user-defined biomedical analyses (e.g., Anatomy [A], Discipline and Occupation [H], Phenomena and Processes [G]). In our two use cases, all scientific publications and their textual data are retrieved from the MEDLINE database using PubMed as the search engine, both managed by the National Library of Medicine. However, the CaseOLAP platform may be applied to other databases of interest containing biomedical documents with textual data such as the FDA Adverse Event Reporting System (FAERS). This is an open database containing information on medical adverse events and medication error reports submitted to FDA. In contrast to MEDLINE and FAERS, databases in hospitals containing electronic health records from patients are not open to the public and are restricted by the Health Insurance Portability and Accountability Act known as HIPAA.
CaseOLAP algorithm has been successfully applied to the different types of data (e.g., news articles)1. The implementation of this algorithm in biomedical documents has been made in 20185. The requirements for applicability of CaseOLAP algorithm is that each of the documents should be assigned with keywords associated with the concepts (e.g., MeSH descriptors in biomedical publications, keywords in news articles). If keywords are not found, one can apply Autophrase6,7&#160;to collect top representative phrases and build the entity list before implementing our protocol. Our protocol does not provide the step to perform Autophrase.
Comparison with other algorithms. The concept of using a Data-Cube8,9,10 and a Text-Cube2,3,4 has been evolving since 2005 with new advancements to make data mining more applicable. The concept of Online Analytical Processing (OLAP)11,12,13,14,15 in data mining and business intelligence goes back to 1993. OLAP, in general, aggregates the information from multiple systems, and stores it in a multi-dimensional format. There are different types of OLAP systems implemented in data mining. For example (1) Hybrid Transaction/Analytical Processing (HTAP)16,17, (2) Multidimensional OLAP (MOLAP)18,19-Cube based, and (3) Relational OLAP (ROLAP)20.
Specifically, the CaseOLAP algorithm has been compared with numerous existing algorithms, specifically, with their phrase segmentation enhancements, including TF-IDF+Seg, MCX+Seg, MCX, and SegPhrase. Moreover, RepPhrase (RP, also known as SegPhrase+) has been compared with its own ablation variations, including (1) RP without the Integrity measure incorporated (RP No INT), (2) RP without the Popularity measure incorporated (RP No POP), and (3) RP without the Distinctiveness measure incorporated (RP No DIS). The benchmark results are shown in the study by Fangbo Tao et al.1.
There are still challenges on data mining which can add additional functionality over saving and retrieving the data from the database. Context-aware semantic Analytical Processing (CaseOLAP) systematically implements the Elasticsearch to build an indexing database of millions of documents (Protocol 5). The Text-Cube is a document structure built over the indexed data with user-provided categories (Protocol 6). This enhances the functionality to the documents within and across the cell of the Text-Cube and allow us to calculate term frequency of the entities over a document and document frequency over a specific cell (Protocol 8). The final CaseOLAP score utilizes these frequency calculations to output a final score (Protocol 9). In 2018, we implemented this algorithm to study ECM proteins and six heart diseases to analyze protein-disease associations. The details of this study can be found in the study by Liem, D.A. et al.5. indicating that CaseOLAP could be widely used in the biomedical community exploring a variety of diseases and mechanisms.
Limitations of the algorithm. Phrase mining itself is a technique to manage and retrieve important concepts from textual data. While discovering entity-category association as a mathematical quantity (vector), this technique is unable to figure out the polarity (e.g., positive or negative inclination) of the association. One can build the quantitative summarization of the data utilizing the Text-Cude document structure with assigned entities and categories, but a qualitative concept with microscopic granularities cannot be reached. Some concepts are continuously evolving from past till now. The summarization presented for a specific entity-category association includes all incidences throughout the literature. This may lack the temporal propagation of the innovation. In the future, we plan to address these limitations.
Future Applications. About 90% of the accumulated data in the world is in the unstructured text data. Finding a representative phrase and relation to the entities embedded in the text is a very important task for the implementation of new technologies (e.g., Machine Learning, Information Extraction, Artificial Intelligence). To make the text-data machine readable, data need to be organized in the database over which the next layer of tools could be implemented. In the future, this algorithm can be a crucial step in making data mining more functional for the retrieval of information and the quantification of the entity-category associations.

Manual evaluation of millions of text files for the study of phrase-category association (e.g., Age group to protein association) is incomparable with the efficiency provided by an automated computational method. We want to introduce the cloud-based Context-aware Semantic Online Analytical Processing (CaseOLAP) platform as a phrase-mining method for automated computation of phrase-category association in the biomedical context.
The CaseOLAP platform, which was first defined in 20161, is very efficient compared to the traditional methods of data management and computation because of its functional document management called Text-Cube2,3,4,&#160;which distributes the documents while maintaining underlying hierarchy and neighbourhoods. It has been applied in biomedical research5&#160;to study entity-category association. The CaseOLAP platform consists of six major steps including download and extraction of data, parsing, indexing, Text-Cube creation, entity count, and CaseOLAP score calculation; which is the main focus of the protocol&#160;(Figure 1, Figure 2, Table 1).
To implement the CaseOLAP algorithm, the user sets up categories of interest (e.g., disease, signs and symptoms, age groups, diagnosis) and entities of interest (e.g., proteins, drugs). One example of a category included in this article is the &#39;Age Groups&#39;, which has &#39;infant&#39;, &#39;child&#39;, &#39;adolescent&#39;, and &#39;adult&#39; subcategories as cells of the Text-Cube and protein names (synonyms) and abbreviations as entities. Medical Subject Headings (MeSH) are implemented to retrieve publications corresponding to the defined categories (Table 2). MeSH descriptors are organized in a hierarchical tree structure to permit search for publications at varying levels of specificity&#160;(a sample shown in Figure 3). The CaseOLAP platform utilizes the data indexing and search functionality for curation of the documents associated with an entity which further facilitate document to entity count mapping and CaseOLAP score calculation.
The details of the CaseOLAP score calculation is available in previous publications1,5. This score is computed using specific ranking criteria based on underlying Text-Cube document structure. The final score is the product of Integrity, Popularity, and Distinctiveness. Integrity describes whether a representative entity is an integral semantic unit that collectively refers to a meaningful concept. The integrity of the user-defined phrase is taken to be 1.0 because it stands as a standard phrase in the literature. Distinctiveness represents the relative relevance of a phrase in one subset of documents compared to the rest of the other cells. It first calculates the relevance of an entity to a specific cell by comparing the occurrence of the protein name in the target data set and provides a normalized Distinctiveness score. Popularity represents the fact that phrase with a higher popularity score appears more frequently in one subset of documents. Rare protein names in a cell are ranked low, while an increase in their frequency of mention has a diminishing return due to the implementation of the logarithmic function of frequency. Quantitatively measuring these three concepts depends on the (1) term frequency of the entity over a cell and across the cells and (2) number of documents having that entity (document frequency) within the cell and across the cells.
We have studied two representative scenarios using a PubMed dataset and our algorithm. We are interested in how mitochondrial proteins are associated with two unique categories of MeSH descriptors; &#34;Age Groups&#34; and &#34;Nutritional and Metabolic Diseases&#34;. Specifically, we retrieved 15,728,250 publications from 20 years publications collected by PubMed (1998 to 2018), among them, 8,123,458 unique abstracts have had full MeSH descriptors. Accordingly, 1,842 human mitochondrial protein names (including abbreviations and synonyms), acquired from UniProt (uniprot.org) as well as from MitoCarta2.0 (http://mitominer.mrc-mbu.cam.ac.uk/release-4.0/begin.do&#62;), are systematically examined. Their associations with these 8,899,019 publications and entities were studied using our protocol; we constructed a Text-Cube and calculated the respective CaseOLAP scores.

cloud-based phrase mining and analysis of user-defined phrase-category association in biomedical publications

The rapid accumulation of biomedical textual data has far exceeded the human capacity of manual curation and analysis, necessitating novel text-mining tools to extract biological insights from large volumes of scientific reports. The Context-aware Semantic Online Analytical Processing (CaseOLAP) pipeline, developed in 2016, successfully quantifies user-defined phrase-category relationships through the analysis of textual data. CaseOLAP has many biomedical applications.
We have developed a protocol for a cloud-based environment supporting the end-to-end phrase-mining and analyses platform. Our protocol includes data preprocessing (e.g., downloading, extraction, and parsing text documents), indexing and searching with Elasticsearch, creating a functional document structure called Text-Cube, and quantifying phrase-category relationships using the core CaseOLAP algorithm.
Our data preprocessing generates key-value mappings for all documents involved. The preprocessed data is indexed to carry out a search of documents including entities, which further facilitates the Text-Cube creation and CaseOLAP score calculation. The obtained raw CaseOLAP scores are interpreted using a series of integrative analyses, including dimensionality reduction, clustering, temporal, and geographical analyses. Additionally, the CaseOLAP scores are used to create a graphical database, which enables semantic mapping of the documents.
CaseOLAP defines phrase-category relationships in an accurate (identifies relationships), consistent (highly reproducible), and efficient manner (processes 100,000 words/sec). Following this protocol, users can access a cloud-computing environment to support their own configurations and applications of CaseOLAP. This platform offers enhanced accessibility and empowers the biomedical community with phrase-mining tools for widespread biomedical research applications.

Watch this Scientific Journal Video about Cloud-Based Phrase Mining and Analysis of User-Defined Phrase-Category Association in Biomedical Publications at JoVE.com

Cloud-Based Phrase Mining and Analysis of User-Defined Phrase-Category Association in Biomedical Publications

We present a protocol and associated programming code as well as metadata samples to support a cloud-based automated identification of phrases-category association representing unique concepts in user selected knowledge domain in biomedical literature. The phrase-category association quantified by this protocol can facilitate in depth analysis in the selected knowledge domain.

The rapid accumulation of biomedical textual data has far exceeded the human capacity of manual curation and analysis, necessitating novel text-mining ...

Research

JoVE Journal

Medicine

Making Sense of Listening: The IMAP Test Battery

The ability to hear is only the first step towards making sense of the range of information contained in an auditory signal. Of equal importance are the ...

Generation of Alginate Microspheres for Biomedical Applications

Alginate-based materials have received considerable attention for biomedical applications because of their hydrophilic nature, biocompatibility, and ...

Quantitative Analysis and Characterization of Atherosclerotic Lesions in the Murine Aortic Sinus

Atherosclerosis is a disease of the large arteries and a major underlying cause of myocardial infarction and stroke. Several different mouse models have ...

The Bovine Lung in Biomedical Research: Visually Guided Bronchoscopy, Intrabronchial Inoculation and In Vivo Sampling Techniques

The Bovine Lung in Biomedical Research: Visually Guided Bronchoscopy, Intrabronchial Inoculation and In Vivo Sampling Techniques

There is an ongoing search for alternative animal models in research of respiratory medicine. Depending on the goal of the research, large animals as ...

Carotid Artery Infusions for Pharmacokinetic and Pharmacodynamic Analysis of Taxanes in Mice

When proposing the use of a drug, drug combination, or drug delivery into a novel system, one must assess the pharmacokinetics of the drug in the study ...

Whole-brain Segmentation and Change-point Analysis of Anatomical Brain MRI&#8212;Application in Premanifest Huntington's Disease

Whole-brain Segmentation and Change-point Analysis of Anatomical Brain MRIÃƒÆ’Ã‚Â¢ÃƒÂ¢Ã¢â‚¬Å¡Ã‚Â¬ÃƒÂ¢Ã¢â€šÂ¬Ã‚ÂApplication in Premanifest Huntington's Disease

Recent advances in MRI offer a variety of useful markers to identify neurodegenerative diseases. In Huntington&#39;s disease (HD), regional brain atrophy ...

Sampling Strategies and Processing of Biobank Tissue Samples from Porcine Biomedical Models

In translational medical research, porcine models have steadily become more popular. Considering the high value of individual animals, particularly of ...

Collecting Hair Samples for Hair Cortisol Analysis in African Americans

The hormone cortisol is typically assessed in saliva, serum, or urine samples. More recently, cortisol has been successfully extracted from hair, ...

A Metadata Extraction Approach for Clinical Case Reports to Enable Advanced Understanding of Biomedical Concepts

Clinical case reports (CCRs) are a valuable means of sharing observations and insights in medicine. The form of these documents varies, and their content ...

Quantitative [18F]-Naf-PET-MRI Analysis for the Evaluation of Dynamic Bone Turnover in a Patient with Facetogenic Low Back Pain

Quantitative [18F]-Naf-PET-MRI Analysis for the Evaluation of Dynamic Bone Turnover in a Patient with Facetogenic Low Back Pain

Imaging techniques that reflect dynamic bone turnover may aid in characterizing a wide range of bone pathologies. Bone is a dynamic tissue undergoing ...