Endeca’s Cyber Situational Awareness

Endeca, the search and discovery firm, has been around for over 10 years now (an eon for a dot.com firm). In 2009, Endeca delivered a complete overhaul of their core indexing technology, and today is now scaling up to billion (yes with a B) record terabyte-scale deployments.  For Big Data deployments, they offer Hadoop integration, virtualization and query federation.

However, for pragmatically minded DoDIIS technologists, the most exciting news from Endeca might actually be the turnkey analytical application that now comes out of the box. This new product cuts the project lead time for analysts to start using capabilities to just weeks, and has already been deployed against requirements that run the gamut from intelligence investigation and financial analysis to supply chain readiness.

Cyber Situational Awareness is a great example of the kind of analytical app that sits in the Endeca wheelhouse. Many streams of data constantly pour into the SOC: log analysis, incident reports, network analysis, threat intelligence, and more. When a significant incident occurs, the urgent question is not only “how do we handle the incident” but “what’s the impact to current missions and readiness?” Endeca lets the SOC answer that question with search/discovery tools, by interactively tracing the dependency relationships that start with the compromised asset or exfiltrated data. All the key data is ingested into a common operating picture, inside which analysts can search, drill and pivot through lists and visualizations of each cyber data source.

For more information on Endeca’s Cyber Situational Awareness check them out at CTOlabs.com

Or online at http://www.endeca.com

 

SMSi’s Twister Data Framework

If you’re interested in data management, servers and integration, check out the Twister booth in the Carahsoft Partner Pavilion on the expo floor here at DoDIIS.  Twister enables ingestion of disparate data sources to provide a searchable, extractable, and highly usable data layer to bring information from across the enterprise, to users throughout it.  Twister offers LDAP integration to identify users – and define roles and access.

Twister offers the ability to read and write Oracle, SQL, MySQL and other such databases.  It can ingest structured data as well unstructured data – providing the capability to process XML, CSV, PDF, DOC and HTML (among others).

The Twister Data Integration layer sits between your choice of databases and your choice of extraction, search or discovery tools.  Providing source and extraction agnostic data integration services enables installation on any system – saving administration from forklift upgrades.

As data sources grow, and gigabytes turn into petabytes, scalable data integration solutions are key to mission success. Pulling in multiple data sources and types, Twister spits them out into clean, usable data for extraction, analysis and aggregation.

Please check out Twister at booth: 831
Or their website HTTP://www.sms-fed.com

Cloudera

 

Cloudera provides a distribution of the Hadoop data management platform known as CDH (Cloudera Distribution of Hadoop). CDH is a comprehensive platform that significantly accelerates deployment of Apache Hadoop. It also provides critical capabilities designed to make Hadoop more useful in the enterprise.

Here are some of the features of Cloudera’s Hadoop distribution:

  • HDFS – Self healing distributed file system
  • MapReduce – Powerful, parallel data processing framework
  • Hadoop Common – a set of utilities that support the Hadoop subprojects
  • HBase – Hadoop database for random read/write access
  • Hive – SQL-like queries and tables on large datasets
  • Pig – Dataflow language and compiler
  • Oozie – Workflow for interdependent Hadoop jobs
  • Sqoop – Integrate databases and data warehouses with Hadoop
  • Flume – Highly reliable, configurable streaming data collection
  • Zookeeper – Coordination service for distributed applications
  • Hue – User interface framework and SDK for visual Hadoop applications

Using the Cloudera distribution for Hadoop provides capabilities that are:

  • Hardened. Patched with future improvements that improve stability and performance.
  • Integrated and simplified. Cloudera manages cross-component integration, versions, and interdependencies.
  • Functionally rich. The broadest feature set of any Hadoop distribution.
  • Proven in the enterprise. In use in financial services, telecom, web, manufacturing, media, and retail industries.
  • Flexible. Run CDH on premises or in the cloud, on multiple OS versions with multiple installation options.
  • Supported. Backed by the project founders and committers.
  • 100% Apache licensed.

Cloudera should be considered the capability of first choice when it comes to big enterprise data management needs.

 

Project Delphi: Integrated Awareness into Mission Environments


Delphi

Intelligence commands throughout government have been buying and integrating capabilities for years. Organizations seek similar platform elements, resulting in many similar solutions. Solutions usually leverage high performance low-cost/commodity hardware, reliable operating systems, linkages to distributed data sources, an ability to index those data sources, tools to correlate and extract data from those indexes, and of course a means to keep the user and the user’s mission at the center of all.

Project Delphi is the transformation of these similar solution stacks into agile platforms for rapid standup of capabilties. The Delphi concept enables enhanced interoperability, enhanced functionality, and significant cost savings based on years of lessons learned and industry best practices. Project Delphi delivers a scalable, modular system ready to perform for your mission.

A platform is something that can be built upon. A well designed platform provides dramatic improvements in capability while also providing a means to continually improve and upgrade for minimal disruption. The collaborative exchange of lessons learned around platform approaches is a critically important benefit, as is the ability to improve platforms through procurements vice lengthy acquisition processes.

Project Delphi: The Integration of Advanced Intelligence IT for the Mission

NuWave Widgets |  Endeca Discovery | MetaCarta | BrightCove | IceWeb

Project Delphi is a multi-component approach that takes best of breed capabilities and creates a synergistic powerhouse. It delivers rapid capability to the analyst at the lowest possible price point and the highest possible interoperability.

Project Delphi utilizes a Widget framework developed by NuWave Solutions, utilizing JackBe’s Presto to build customizable Endeca widgets based on user needs. Users determine what data they want to interact with and can change that depending on their mission needs through drag and droppable widgets. NuWave’s innovative approach to integrating these capabilities allows portal users to siphon and share data throughout the enterprise. NuWave’s Widget framework was developed to enable clients to realize the benefits of cloud computing.  This includes true abstraction of underlying infrastructure and services, paving the way for smaller, leaner applications that can be developed and deployed quickly, and deployed/ported in multiple environments, including portals, and webtops.

FASTER DEVELOPMENT/DEPLOYMENT – Mashlets & widgets can be built and deployed in a matter of weeks. Self-contained widgets can be tested independently. No need to re-test the entire environment. Once tested they are added directly to the Storefront for your users.

REDUCED RISK – Smaller, more focused apps limit exposure No more large, complicated web applications that take forever to build & don’t hit the mark. Small, targeted applications focus on specific functionality – quickly, inexpensively, and, more user-friendly.  This reduces risk all around.

PORTABILITY – Freedom to move between  environments With minimal effort (hours, not weeks or more) code can be adapted to run as a JSR 168/268 portlet, a web application deployed to Apache or Jboss, and JackBe.

DISTRIBUTED PROCESSING – Scalability & interoperability Freedom from the details of the infrastructure enables scalability, and the ability to easily share applications across organizational, geographical, & other boundaries.

BETTER PERFORMANCE – App be nimble, App be quick…. Smaller applications, distributed processing, device and platform independence, and a variety of Web 2.0 technologies enable a variety of options to ensure performance isn’t an issue for your users.

NuWave Solutions, LLC is a technology consulting company that provides visionary ideas and then executes on them fast. NuWave builds frameworks, frees data for consumption, and works visualization and user interfaces in ways that serve and support enterprise missions and their users.  They work with existing enterprise data and applications and deliver capabilities that just blow your mind.  For more on NuWave see:  http://www.nuwavesolutions.com.

The integration of Endeca’s search and discovery capability ensures that analysts get the answers that they need.Endeca can sort through massive amounts of a data in a quick, useful and scalable fashion (Endeca has been proven to scale larger than any other discovery tool available in enterprises today, and operates on some of the largest datasets in the community). Endeca helps users find what they need to know, incorporating a programmable lexicon. Endeca, in Project Delphi, comes connected to MetaCarta, the leading geospatial solution. With Endeca and MetaCarta, searching for location based data is easy and discovering data through locational interfaces is also a snap. In today’s operating environment, geotagging and location are a key part of analysis. Leveraging geospatial data is instrumental to good decision making and MetaCarta is the forerunner in this field.

It is the user that must be served by the solution and as the user creates new hypotheses based on rapid iteration with the systems the visualizations they interact with should reflect other options and allow for more instantaneous interactions. Endeca enables this in a means scalable over very large data stores.

As analysts interact with data it is increasingly important to capture their thoughts by tagging, and enterprise social software Jive enables just that. Video is also integrated and taggable and Brightcove’s video extensible video package enables just that, instantly providing analysts with more tools.

The Project Delphi solution is a complete platform and a ready to run solution. It runs on extremely fast state of the art IceWeb hardware. This hardware can be put directly into your data center, or in a hardened appliance case for deployments. Project Delphi is ready for Network Operating Centers or Tactical Operations Centers all over the world. Truly a deployable asset, the Project Delphi tool chest provides analysts with secure and collaborative tools that are force multipliers.

 

——————————————-

For more information see:

Endeca – For guiding users to the relevant results.  Scalable to incredibly large datasets and blindingly fast speeds.  Used by the most forward leaning organizations globally.

NuWave Widget Framework – Developed to bring the power of enterprises to the end user. Works very well with Endeca.

MetaCarta – For use of Endeca and other tools in the context of geospatial information.

IceWeb – For high power/commodity-cost computer platforms ready for global deployment.

Inxight Thing Finder -For extraction of named entity from unstructured (and structured) content.

Brightcove - For dramatically enhanced video and dramatically enhanced analysis associated with video content. Tied to very fast Enedca search over very fast IceWeb I/O.

 

Endeca

Endeca remains the most disruptive capability in the search and discovery field today.  They provide capabilities to users including ways to find information needed without having to know exactly what to look for.

Endeca provides a platform for search applications that enables more than 250 million users around the globe to access information quickly and easily.  Endecapowered solutions give greater visibility into information, enabling discovery of results in your content faster.

Endeca’s search and discovery solutions outstrip regular search abilities. Endeca is designed so that it enables decision making by creating configurable discovery and search-based business applications.  Endeca allows users to access any data values, irrespective of location or source.

Because of its powerful new capabilities it belongs in any integration that focuses on users, especially analysts.