Novetta

NOVETTA NEXUS
Big Data and Entity Analytics

Entity Graphs with Novetta Entity Analytics and Amazon Neptune

Category: Big Data and Entity Analytics / Novetta Blog Tag(s):  /  /

by

When extracting value from data, organizations often encounter challenges such as datasets of varying schemas, large volumes of data, and missing unique identifiers which enable entity linking. Novetta Entity Analytics (NEA) is an analytics engine capable of scaling to tens of billions of records across hundreds of datasets, generating well-resolved entities and deriving previously unknown links. Entity Graph Generation through Novetta Entity Analytics NEA helps users discover relationships by grouping and linking results based on customized strategies. Grouping, also known as entity resolution, is a strategy-based process of identifying records from data sources as belonging to distinct groups. Linking is...

Read More

Enriching Entities In Your Data Lake

Category: Advanced Analytics / Big Data and Entity Analytics / Novetta Blog Tag(s):  /  /  /  /  /  /  /  /  /

by

Overview Many of our customers have incredible amounts of data scattered across their organization. They know hidden information is locked away, but they need ways to integrate that information and bring it to bear on their missions. One approach to data management is to bring all your data to one place by implementing a data lake – centralizing and storing structured and unstructured information in disparate data sets together. Data lakes drive additional insights into your entire data holdings, enriching the full picture and enabling uncovery of previously unknown links. Storing raw data alongside the results of derived analytics and...

Read More

Deploying Machine Learning at the Edge

Category: Advanced Analytics / Big Data and Entity Analytics / Novetta Blog Tag(s):  /  /  /  /  /  /

by Kevin Heald, Matt Teschke

From the team that presented AWS re:Invent 2018 session WPS304 “Rapid Prototyping for Today’s Mission”.   Problem It’s imperative for warfighters to have actionable, up-to-date knowledge about their adversaries. This requires having the ability to quickly process and analyze new data when and where it is discovered. The current procedure for gathering, processing, and analyzing data can take weeks or months due to logistics, transport, and data handling complications. Using the AWS Snowball Edge, this entire process can be automated, delivering insights from data collected in the field within minutes or hours.   AWS Snowball Edge The Snowball Edge is...

Read More

Novetta has BIG PLANS for AWS re:Invent 2018

Category: Advanced Analytics / Big Data and Entity Analytics / Novetta Blog Tag(s):  /  /  /  /  /  /

by Holly Bone, Katy Jones-Powe

Novetta is excited to return to one of the world’s largest tech conferences, AWS re:Invent! This year there are even more ways to engage with us in Las Vegas. For the first time, Novetta will have leaders on stage in two speaking sessions, we are returning to our suite at the Venetian to give customized demos, and we are sponsoring two Worldwide Public Sector (WWPS) events. As in all great partnerships, Novetta and AWS are better together.  Novetta’s advanced analytics technology is enhanced by AWS services and we are proud to offer our support, and contribute our expertise and innovation,...

Read More

NLP Transfer Learning on SageMaker

Category: Advanced Analytics / Big Data and Entity Analytics / Data Analytics / Novetta Blog Tag(s):  /  /  /  /  /  /

by

Novetta Machine Learning Center of Excellence effort to develop a deep learning model that predicts customer-relevant metadata tags for unstructured text.   BACKGROUND: ENRICHMENT OF UNSTRUCTURED TEXT DATA The rise of the internet has led to a faster flow of information, where news posted to a relatively obscure blog can be shared on social media and then reach national publications within hours. The volume is such that humans alone cannot filter out noise, identify important new information, and determine how messaging trends are changing over time. To address this challenge, Novetta Mission Analytics (NMA) helps customers analyze open source and...

Read More

Cyber Self-Defense: Five Ways to Protect Yourself

Category: Advanced Analytics / Big Data and Entity Analytics / Data Analytics / Novetta Blog Tag(s):  /  /  /  /

by

  1. Be aware that you ARE a target. We hear it in Cyber Security circles pretty often; “I/we/my company doesn’t have anything Hackers want.” According to Verizon’s Data Breach Investigations Report (DBIR) for 2018, 76% of breaches were financially motivated. Attackers want your Personally Identifiable Information (PII) so they can assume your identity not only to steal your hard earned money from your bank accounts and Paypal account but also to apply for fraudulent credit cards. Cyber Criminals will even go as far as stealing a very young child’s identity to apply for credit and open up fraudulent accounts....

Read More

Named Entity Recognition and Graph Visualization

Category: Advanced Analytics / Big Data and Entity Analytics / Data Analytics / Novetta Blog Tag(s):  /  /  /  /  /  /

by

PHASE I RECAP We are exploring the problem space of Named Entity Recognition (NER): processing unannotated text and extracting people, locations, and organizations. A previous post described our comparative performance evaluation of several open source and commercial NER libraries. Based upon this evaluation we determined that Amazon Comprehend (an AWS solution) performed robustly against test corpora, while the top open source solutions for the NER task were AllenNLP ELMo, Stanford NER Tagger, and NeuroNER. PURPOSE This blog post picks up where the previous post left off, building on evaluation results to explore a practical application of NER. TOOLS To facilitate this...

Read More

Evaluating Solutions for Named Entity Recognition

Category: Advanced Analytics / Big Data and Entity Analytics / Data Analytics / Novetta Blog Tag(s):  /  /  /  /  /  /

by

BACKGROUND Named Entity Recognition (NER) and Entity Extraction are interchangeable terms that refer to the task of classifying “named entities” into pre-defined categories such as the names of persons, organizations, locations, etc.1 Let’s look at an example of how this actually works. Given a sample input: John went to the Bank of America in Washington DC An NER algorithm will read in this sentence and look to tag words it recognized as persons, organizations, locations, etc. The following represents the tagged version of the sentence: [John]PERSON went to the [Bank of America]ORGANIZATION in [Washington DC]LOCATION Such tagging is useful because...

Read More


To gain insights into the state of the art of Named Entity Recognition (NER) solutions, Novetta conducted a quick-look study exploring the entity extraction performance of five open source solutions as well as AWS Comprehend.

Accelerating OSINT Analytics through AWS Machine Learning Services & AWS Neptune

Category: Big Data and Entity Analytics / Novetta Blog Tag(s):  /  /  /  /  /  /  /  /  /

by

by Matt Johannessen Novetta’s business covers a diverse mix of public and private sector customers. While mission objectives vary, we are seeing an increasing need to extract meaning from high-velocity open source (OSINT) information. Historically, deriving intelligence from open source digital content has been complex and time consuming, particularly when high-accuracy results are required. Generating meaningful signals from data sources such as web content and open source video has required substantial labor on the part of analysts. We are working to significantly reduce the effort required to gather and exploit OSINT through a combination of machine learning, graph database technologies,...

Read More

Predictive Analytics for Intelligence

Category: Big Data and Entity Analytics / Novetta Blog Tag(s):  /  /

by

The role of qualitative research in predictive analytics Novetta’s portfolio of work stretches across the public and private sectors. One common thread across many of our projects is our clients’ need to quantify risk, and make decisions in the presence of uncertainty. Whether it be identifying travelers at risk of human smuggling or protecting critical technologies; our clients are faced with a myriad of challenges. They must make decisions about these threats, and the cost of a wrong decision often goes well beyond lost resources. They’re also surrounded by data. It comes in all forms and sizes, and is usually very (very,...

Read More