Welcome to Quantexa 2.3 | 2.3.0 Release Announcement
In Quantexa 2.3, you will find: Entity Store, a new component in our set of Entity Resolution capabilities; Introduction of Security Model V2, a new way to manage Role-Based Access and Control within The Quantexa Platform; Enhancements to Assess including Path Ranking, a new way to define paths; Support for Elasticsearch 8 and Spark 3.2. Entity Store In 2.3.0, we are introducing Entity Store in beta. Before 2.3.0, all interactions with the Quantexa UI and the Quantexa Mid-tier APIs depended upon resolving Entities on-the-fly (dynamically). The Entity Store allows a persisted or materialized view of Entities to be stored in the system. In this first release, the core Entity Store will load a full set of pre-resolved Entities produced by Batch Resolver, into Elasticsearch. The Entity Store can then be used by Explorer to enable querying of the underlying entities, as a Cache for Resolver to improve performance, and to support the new Entity REST API. Security Model V2 We have introduced a new framework for authentication and authorization across the platform. This gives the platform greater control over the data and features that a user can access and enables easier integration with Identity Providers (IdPs). End-users no longer need to interact directly with low-level Quantexa Roles. They are now able to share their work with Groups that are logical to their organizational structure. For example: UK Fraud Investigators. Using a new User Management Screen, you can now provision users and Groups, collections of users that can be assigned Roles and Dynamic Privileges, to The Quantexa Platform from Identity Providers simply and easily. Path Ranking It is now possible to specify the rules for defining the relative importance of paths, a chain of Documents and Entities that connect two Nodes, when writing Network Scores with Path Ranking, which make the Network easier to analyze by signaling the most significant areas to explore further. Dual Context Sources Dual Context Sources enable scoring logic to be designed that will work in both batch and dynamic, and provides a config-based tool that generates Source steps for both pipelines. This simplifies the deployment of a build with a dual architecture. Support for Elasticsearch and Spark Quantexa now supports Elasticsearch 8 across the platform, except for Offline Indexers and Spark 3.2 is now supported across the platform. Warning: Spark 3.0 is deprecated and support will be removed completely in the next release of the platform. Spring Boot upgrade Spring Boot has been upgraded to version 2.6.8. This results in faster startup times and solves a number of security vulnerabilities found in older versions of Spring Boot. Documentation Site Glossary We have completely revamped and reworked our Documentation site glossary, adding almost 100 new terms. Explore the Glossary to find out more. Other highlights For more control and flexibility when running ETL, Quantexa has has added the ability to generate Resolver Search Loader and Compound Creator scripts at the point where users define a Root Model in Data Fusion. List inputs have been introduced for Entity Attribute functions, to allow for more flexibility and customizability, granting users more ways to define Entity Attributes in Data Fusion, and cater to a wider range of data models. You are now able to collapse the Query Builder in Explorer. This is the next step in improving the user experience of Explorer, allowing users to focus on the results of the query. You will find the full set of Release Notes on the Quantexa Documentation site. If you are unable to access them, you will need to get a user with access to submit a Documentation site access request through the Quantexa Support Portal.
Welcome to Quantexa 2.5 | 2.5.0 Release Announcement
We are pleased to announce Quantexa 2.5! Read below for a few exciting highlights. Stream Updates to the Entity Store The Entity Store can now be updated with a streamed ingest of new Documents, and creates a change log describing how the Entity population has changed. In combination with the ability to query the full population of resolved Entities, this update enables near real-time access to the most up-to-date view of your data. Why is this important? Users and downstream systems can now get the latest view of an Entity resolved by Quantexa, enabling business processes that need to access or act upon that update in near real-time - in a Master Data Management solution (MDM), for example - to do so. Deploy and Change Custom Scoring Pipelines through Configuration The addition of Scoring Extension Mode to the Assess Template Generation functionality helps simplify the process of setting up Scoring on a project. With the new Extension Mode, it is now possible to change and add new nodes to a custom Scoring model using configuration files. Why is this important? This significantly reduces the technical skills required for setting up the Scoring pipeline and makes the generation of a custom Scoring pipeline more flexible. Flexible Scorecards: Identify and Aggregate Insights Across Multiple Typologies Assess capabilities and helper functions have been added to support multiple Scorecards on the same level within one Scoring pipeline. Scores can contribute to one or more Scorecards and flexible alerting logic can be set up to include the outcome of multiple Scorecards. Why is this important? This enables the flagging of different types of risks or insights at the same level - for different typologies or different products, for example - and helps an investigator or analyst understand and act upon the full context of the data available. Tune Scorecards with QPython QPython utilities can now interact with Assess configuration files and Scoring pipelines, which simplifies the process of tuning a Scoring model, providing an easy way to conduct a what-if analysis. The interface, using pre-written Python Notebooks, calculates a set of the most common and useful metrics for tuning. The use of Jupyter Notebooks allows the export of the reports for inclusion in the wider model governance process. Why is this important? Scorecard tuning is one of the most important parts of model development, as the model must output the most relevant (e.g., risky or interesting) information for a specific use case. These utilities make the process of Scorecard tuning much more accessible, simple, and quick. It also makes sure that the model addresses the business need and risk appetite of the deployment. Other highlights Speed up and simplify deployment of Explorer with no-code configuration; Merge and split Entities, and override Entity Attributes through the Entity Management Panel (e.g., for Master Data Management solutions); Integrate with Kafka streaming typologies more easily. Share your thoughts on this release in our poll: Which feature of Quantexa 2.5 are you most excited for? To receive updates on every release, be sure to follow the Release Announcements topic: Want to learn more? Check out the Release Notes on the Quantexa Documentation site. If you are unable to access the Documentation site, please get in touch with your Quantexa point of contact or the Community team at community@quantexa.com.
Entity Resolution tooling and best practices
Entity Resolution (ER) has always been the heart of any Quantexa solution and plays a significant role in the successful outcomes delivered. As we continue to improve this capability, we are working to make Entity Resolution clearer and lower the barrier to entry for all users. We are happy to announce we’re introducing new and improved documentation, focusing on how to understand your Entity quality and leverage new Entity Resolution tooling through best practices and guides. Why Entity quality? Understanding and assessing the quality of Entities within any solution is often complex as it requires specialized skills, knowledge and resources such as: the ability to write Scala queries, knowledge of the batch build output, time as investigations and queries often have long elapsed times, expertise in understanding and interpreting the results as well as recommend resolutions. This means that quality assessment historically could only be carried out by those with the required technical expertise, which could lead to investigations taking longer than necessary. What’s new? An earlier release of the Statistical Profile Testing (SPT) framework and the Bad Entity Analyzer (BAE) reduced the requirement level for both writing Scala and knowledge of the batch output. Although having these tools made assessing Entity quality much easier, we discovered a way to streamline the process even more. In the Quantexa 2.4 release, we integrated the Entity Explorer and Entity Quality Score into the Entity Resolution capability, making the visibility and overall understanding of the Entity quality a focus. You said; we did Whilst the introduction of new tooling is key, based on your feedback we've also identified the need for better documentation on Entity Resolution best practices, specifically on how to get the most of the features associated with tuning and analyzing Entity Resolution. We are pleased to say we have created a whole new Entity Resolution tuning best practice space within Quantexa Documentation in the Quantexa 2.4 release section. The new section will help offer advice and guidance through the process to help understand: Why is it important to validate an Entity Resolution run? What are the signs of poorly resolved Entities? How do I use Quantexa tooling to simplify ER tuning? The documentation contains dummy examples of how to use the Entity Quality Scoring, Entity Explorer and Entity Lab to find, understand and propose suggestions on how to fix some common issues discovered. Watch out for future documentation on additional tooling and guidance around Entity Resolution processes as the site updates alongside Quantexa releases. Additional Resources For more information on Entity Resolution check out our blog on Using base Entity Resolution configuration for the first time. Whilst Quantexa's standard Compounds will support most use cases, there are situations where specific Compounds will be needed. See our article What Makes a Good Compound giving guidance and considerations to help with Compound creation. Entity Resolution (ER) and good Entity quality underpins all Quantexa deployments. Therefore, we recommend that Entity Resolution is monitored and reviewed through all stages of development. Our Entity Resolution general playbook describes the best practice process for monitoring and reviewing Entity Resolution within Quantexa.
Elevating Data Management: Unveiling the Pillars of a Trusted Data Foundation with Quantexa
Hi Community! We are all well aware that data teams are faced with increasingly complex business challenges and not being able to make the most of their data makes it very hard to reach strategic, tactical and operational goals set by their organizations. The solution to that is building a truly trusted data foundation. As part of Quantexa’s ongoing commitment to providing best-in-class Data Management solutions to address the latter, the team at Quantexa has had a brainstorm of what aspects are crucial when choosing one, and what we – as a team – are focusing on when building our solutions. Let’s go through some of the main components. 1. Quick multi-source data ingestion: A common challenge is the complexity and time required to get data in the platform. To address that, we apply intelligent data cleansing and enrichment processes and accelerate data onboarding with low-code, schema-agnostic, scalable, high-performance data preparation and ingestion for both internal and external data sources. 2. Truly accurate data matching through Entity Resolution: Without a holistic view of your data, it’s impossible to make informed decisions. Our AI-powered Entity Resolution uses transparent and tunable models that are designed to address common problems associated with traditional matching methods such as data availability and quality issues with proven 99% accuracy. 3. Quality scoring and corrections: Even with the best matching engines, there is always going to be a need for a Data steward’s input: monitoring and continuous data quality enhancement. We provide tools to review the quality score of each entity down to understanding exactly what contributed to a score, quickly identifying source system issues to address. There is also an easy way to correct the data, e.g. merge entities, without needing to adjust the source data, which is incredibly valuable both for immediate use in your analytics and also for any consuming system. 4. The use of Graph Analytics: Connecting data in a meaningful way is a crucial, but the next step is to really uncover the relationships you need for the business problem you are solving. For that our users are able to use advanced Graph Analytics technology to uncover the intricate networks of real-world connections and relationships between entities – building even complex corporate hierarchies or family relationships. Take a look at our video, where , Solutions Lead, shows examples of these capabilities in the Quantexa platform. Find this article interesting? Check out these related posts: Join our Data Management User Group to connect with peers on this topic and share knowledge and expertise on all things data management.ER Accelerate – a low-code and UI-driven approach to Quantexa’s Entity resolution
Following Jamie Hutton’s (CTO, Quantexa) announcement at Quancon last Tuesday, we are excited to spill the beans on ER Accelerate and Quantexa’s journey to simplification so far. Here is a quick Q&A with @Jamie Q: What is ER Accelerate all about? A: Simply put, ER Accelerate is all about enabling our customers to unlock the power of our best-in-class Entity Resolution capability in a much easier and quicker way. We’ve been investing heavily in simplifying the process of deploying, onboarding data, and configuring our platform and ER Accelerate marks a major milestone in our efforts to increase and speed up the adoption of Quantexa. And you’ll be seeing this simplification across the other key areas of our platform in the near future as well. Q: What is new in ER Accelerate? A: The most exciting difference with ER Accelerate is that a user will be able to deploy the solution, configure their data model and entity resolution, execute a batch ER run, and view the results – all without having to write any code! This will enable our customers to get up and running and start delivering value from our product much more quickly. To do this, we’ve bundled new or existing platform components that simplify the process of data ingest (Data Fusion UI) and Entity Resolution (Resolver) into one package and paired that with the ability to view and explore entities (Entity Explorer powered by Entity Store) and assess their quality (Quality Scoring). Q: You mentioned that ER Accelerate is going to be released via an Early Access Program (EAP) for now. What does that mean to our customers and partners? A: The reason we are going through an EAP is that we want to put our users’ needs to the forefront. During the EAP, which will take about 3 to 4 months, participants will be trying out the product with our guidance and we will be collecting feedback for inclusion in the product development process. This means when we bring ER Accelerate to general availability, it will be well tested in real-life use cases and enriched with functionality that our users need. Find out more about ER Accelerate here.
How Contextual Monitoring is a game changer for Correspondent Banking AML
Join and for a short Fireside Chat session to learn more about Correspondent Banking and how next generation monitoring can help: Overarching topic: What can institutions do to improve their AML monitoring capabilities in the Correspondent Banking space. Can leveraging Entity Resolution and data enrichment reduce alert volumes and improve effectiveness in monitoring operations? You can also read more in our 'The Wild West of Banking' blog!
📢 New Education Program Launch 🚀 | Quantexa User Foundations Release 2
Education Services is delighted to announce Release 2 of the eLearning program Quantexa User Foundations. Release 2 promises a more engaging and efficient learning experience. With a streamlined scope of information, you'll breeze through the program, without sacrificing depth or quality. Moreover, Release 2 features videos, new interactive content, and extended accessibility features. Program components: Introduction to Quantexa Decision Intelligence Platform 🆕 Quantexa Foundations: Core Concepts Quantexa Foundations: Search Quantexa Foundations: Investigations New in Release 2: New Timeline UI Entity Management Product version 2.5.2 Initially, this new version will be launched as an individual package but it will also form part of the Quantexa Investigations Series: AML Investigator program. Later in 2024, it will be integrated into other education programs as part of the release of the new version of the Technical Foundations. For further details on the range of programs our Quantexa Academy offers, read the following Community article: Introduction to the Quantexa Academy.Tips and Tricks for Understanding Entity Lab
Entity Lab can be quite complex to understand and review when searching for Entity Resolution problems. To help with this, we've compiled some tips and tricks for what to watch out for that may help you quickly understand the health of your entities as well as some common shapes you may encounter, including: Signs of Possible Overlinking Signs of Underlinking Possible Aggregation Issues Read the full article: Tips & Tricks for Understanding Entity Lab (login required) Tips and Tricks for Understanding Entity Lab - Quantexa Community Entity Lab can be quite complex to understand and review when searching for Entity Resolution problems. Below are some tips and tricks for what to watch out for that may help you quickly understand the health of your entities as well as some common shapes you may encounter. Signs of Possible Overlinking Look for lots of…
Advancing Correspondent Banking Insights: Managing Respondent Banks Risk
As a follow up to my previous blog on Managing non-customer risk in Correspondent Banking, I have written a new blog on Managing Respondent Banks Risk. 3 key points from the new blog are: Correspondent Banking Risks: The article explores risks in correspondent banking, covering both macro and micro aspects. FATF Recommendations: FATF advises correspondent banks to manage risks through updated customer due diligence on Respondent Banks, considering their customer types, and profiles, with a focus on leveraging technology. Quantexa's Solution: Quantexa's Decision Intelligence platform, using Entity Resolution and Advanced Analytics, offers a tech-driven solution for understanding and managing risks in correspondent banking. Read more in the new blog: How to Manage Correspondent Banking Risk - Quantexa
Why Does Entity Quality Matter? & Best of the Community from March
March Top Picks Why Entity Quality Matters 🔐login required Enter our latest competition: The Knowledge Exchange 📝 New Education Programs: Scala & Spark Bootcamp and Quantexa Data Engineer Velocity Program Quantexa & Xander Talent - New Education Partnership 🤝 Elevating Data Management: Unveiling the Pillars of a Trusted Data Foundation with Quantexa Latest from the Community Library 📖 A day in the life of a... Senior Learning Designer A day in the life of... an Academy Trainee How To Test Your Upgrades 🔐login required Updates to Quantexa Supported Versions 🔐login required Upcoming events 🗓️ 3rd May Community Connect 👋 Join for a demo of top Community features. Best of Q&A ✅ Unable to load Batch Scores to Elastic 🔐login required How to fix image style for investigation icon in the Qx UI? 🔐login required Error creating bean with name 'springSecurityFilterChain' 🔐login required New & Popular Ideas💡 Usability increase using 2 screens for investigations 🔐login required Changing the default settings for Graphic Filters in Data Viewer 🔐login required Make updates to metadata.parquet optional 🔐login required In case you missed it 📣 Welcome to Quantexa 2.6 | 2.6.0 Release Announcement 🏆 Badge of the Month: The Name Dropper Badge Community quick links 🚀 Submit and vote for Ideas in our Ideas Portal 🗣️ Join one of our Specialist User Groups: FinCrime, Insurance, Data Management & KYC 📚️ Browse blogs, articles and guides in our Community Library
