Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  • Some experience with the Mercurial Distributed Version Control System (DVCS), such as how to "clone" a repository (see "Mercurial: The Basics" at http://hgbook.red-bean.com for more information).  For users who want to browse the source but don't have or don't want to use DVCS, a ZIP archive of the source can be downloaded from any of the source repositories (however, be aware that the top-level directory name in a downloaded ZIP archive will be different than what it would be if the repository were cloned with the DVCS).
  • Familiarity with editing properties files and other configuration files as part of a build process.
  • Some experience with a Java Application Server such as Glassfish or Tomcat
  • A Windows, Linux, or Mac system with:
    • Java (JDK) version 6 or version 7 (version 8 and higher is not compatible with Glassfish 3.1.2)
    • A Mercurial DVCS client ("hg")
    • Apache Maven, a software project management and build tool
    • Glassfish version 3.1.2 (available at http://download.java.net/glassfish/3.1.2.2/release/glassfish-3.1.2.2.zip)
    • Tools to download and manipulate test data sets using the DS2 Data Scripts project: SQLite; Perl with DBI module, SQLite DBD module, and Text CSV module; wget, tar, gzip, unzip
    • Optionally, WEKA data mining software to create predicates other than the Naive Bayes predicate (information at the Software Used by DS2 page)
  • Most of the above prerequisites (except Glassfish and WEKA) are easily obtainable via package managers such as yum or apt (Linux); Fink or Homebrew (OS X); Cygwin (Windows).  For example:
    • Fedora Linux version 19: sudo yum install perl-DBD-SQLite perl-Text-CSV hg maven java-1.7.0-openjdk-devel unzip
    • CentOS version 6.5: sudo yum install perl-DBD-SQLite perl-Text-CSV hg java-1.7.0-openjdk-devel unzip wget dos2unix (maven will need to be downloaded and installed manually)

...

If you want...You'll need to install...
CCD-to-vMR conversion only

CDA Web Service (also known as "CDA Redaction Web Service")

CDA Predicate Reducer Web App for a web browser-based front-end to the service

Web-based CCD editing onlyCAT CDA Plug-in (including the CDA MTS Service and CDA CAT Web Application)
CCD redaction via web service - deterministic rules only

Predicate/Reducer

CDA Web Service (also known as "CDA Redaction Web Service")

CDA Predicate Reducer Web App for a web browser-based front-end to the service

CAT CDA Plug-in (including the CDA MTS Service and CDA CAT Web Application) for an optional web-based test manager

CCD redaction via web service - with probabilistic rules

Installation video available

DS2 Data Scripts

NaiveBayesPredicate (for native Naive Bayes classifier) or RandomForestPredicate (for any WEKA classifier – see "Classifier development and testing" below)

Predicate/Reducer

CDA Web Service (also known as "CDA Redaction Web Service")

CDA Predicate Reducer Web App for a web browser-based front-end to the service

CAT CDA Plug-in (including the CDA MTS Service and CDA CAT Web Application) for an optional web-based test manager 

HIE Prototype with all of the above

Install everything for CCD redaction via web service - with probabilistic rules (Test Manager not required)

Then install the HIE Prototype project

Inference Analyzer only

Installation video available

DS2 Data Scripts

NaiveBayesPredicate

RandomForestPredicate

Inference Analyzer  

Classifier development and testing

Installation video available Image Added

DS2 Data Scripts

WEKA (see Software Used by DS2)

...

Predicate Reducer Video continues from where the Inference Analyzer Video left off and compiles from source and installs Predicate/Reducer, CDA Web Service, and CDA Predicate Reducer Web App.

Image AddedClassifier Experimentation Video demonstrates how to download, install, and use WEKA, along with the DS2 Data Scripts project, to explore different classifiers for Decision Support for Data Segmentation.  Users can follow along from their own desktop or create a cloud-based Linux desktop as used in the video and demonstrated in the Create a Cloud Desktop video. 

Source Code

All project source code is available for download at the DS2 Bitbucket Repository, https://bitbucket.org/sharps-ds2.

...