Introducing pyHQL as a Python Library to ASAM ODS

pyHQL (ASAM ODS Toolbox for Python) enables analysts and engineers to utilize the HighQSoft Query Language (HQL) to work directly with ASAM ODS data from Python, providing typed results, mass-data access with units, transactions, and file streaming for analysis, scripts, and dashboards.

 

HighQSoft is introducing pyHQL, a lightweight Python library that connects to the HQL WEB Service and, through it, to any ASAM ODS server in your infrastructure. You use familiar HQL commands to query metadata and measurement data. pyHQL maps ASAM ODS datatypes to convenient Python objects, allowing you to analyze them immediately.

What’s new?

pyHQL eliminates the effort of crafting low-level REST calls and interpreting ASAM ODS datatypes by providing a ready-to-use library—so teams can spend time analyzing data and focusing on insights rather than integration work.

The HQL Web Service delivers product-based stability and all HQL comfort to the Python end-user.

What you can do with it:

For End-users

  • Query information easily — Use the same HQL queries you already know to retrieve any information from ASAM ODS servers - with all the comfort you'd expect!

  • Work natively in Python & Data Frames — Stay in your comfort zone with Python, Pandas, and friends.

  • Transactions & file streaming — Open/commit/abort transactions from Python; upload and download files via dedicated helpers. Uncommitted transactions are safely aborted on disconnect.

For Analysts & Data Scientists

  • Create dashboards — Build dashboards on ASAM ODS data with Plotly or other tools on top of typed results.
  • Write helper scripts — Quickly retrieve and prepare ASAM ODS data for engineering teams or process information for other stakeholders.
  • Automate pipelines — Combine pyHQL capabilities with Merlin’s pre-built stages to retrieve and write information from ASAM ODS and implement automated processing pipelines.

For Administrators

  • Product Stability — Built on the well-maintained HQL WEB Service for consistent, predictable behavior.
  • Simplicity — Get users started fast with a straightforward, two-URI connection model.
  • Compatibility — Works with ASAM ODS 5 and ASAM ODS 6.

A 30 seconds example to success

from highqsoft.pyHQL.HQL import HQL ASAM ODSURI="hql://admin:admin@localhost:xxxx?licenseserver=xxxx@licenseserver"
hqlURI="http://192.168.xxx.xx:xxx"

 

hql = HQL(hqlURI, ASAM ODSURI)

 

>>> result = hql.query("hql id, name from aotest")
>>> print(result)
---------------------------------------------------------
| Station 0.056 seconds to fetch 83 rows with 2 columns |
| id | name |
---------------------------------------------------------
| 26 | Alsfeld |
| 5 | Neuruppin-Alt Ruppin |
| 45 | Anklam |
...
| 81 | Veilsdorf |
| 82 | Oberhaching-Laufzorn |
| 83 | Waltrop-Abdinghof |
| 61 | Helmstedt-Emmerstedt |
---------------------------------------------------------
83 rows selected
---------------------------------------------------------
Query time: 0.056 seconds
Printer time: 0.001 seconds
Execution time: 0.057 seconds

Availability

pyHQL is available now as a ZIP for pip install from the HighQSoft download page. The manual includes installation steps, connection examples, and a quick tour of queries, mass data access, transactions, and file transfer.

 

#ASAM #ODS #TestData #Merlin #Python #pyHQL #TDM #TestDataManagement #ASAMODS #HighQSoft

Merlin UI for ASAMCommander — Launch, schedule, and monitor server‑side analyses without leaving your ODS web app. Standardized execution, resource management, and full data lineage. First release targeted end of 2025.

HighQSoft is introducing the Merlin UI, a new module for ASAMCommander that brings server-side analysis and job orchestration right into the end-user’s web application. Engineers can discover data, launch analyses, and monitor pipelines end-to-end—without leaving ASAMCommander.

 

Why it matters

As data volumes grow, manual, desktop-based analysis tools don’t scale. Merlin is a second-generation, technology-independent framework that standardizes execution so teams get faster, comparable, and reproducible results.

 

What's new?

The following features are introduced:

 

For End-users

  • Start Job toolbar action available across multiple modules to launch analyses from within ASAMCommander.

  • Job bookmarks to quickly re‑run jobs or review prior results.

For business admins

  • Template Manager to control which job templates are available to end users.

  • Template Builder (Code & Graphical) to design and operationalize evaluations.

  • Job Monitoring & Logging for live status, history, and traceability.

  • Data Lineage to trace software, processes, and all interactions with your datasets.

 

Automation of Processing jobs with Merlin - UI for the Blueprints Manager

What you can do with it

ASAMCommander is a modular ASAM ODS web application for data exploration and management. Out of the box, ASAMCommander already integrates expert tools like AVL Concerto, MATLAB, and NI DIAdem, and supports exporting ATFx, CSV, and MDF4—so you can keep preferred workflows in one place.

Merlin extends this with:

  • Technology-independent executors (Python, Java, MATLAB, Spark)

  • Resource management, queuing/scheduling, and event triggers (e.g., on import)

  • Standardized, comparable results with full data lineage

Template types supported include importing, data validation, processing/analysis, statistics generation, archiving, and maintenance tasks.

 

About Merlin/Sam Analysis Server

Merlin is a second-generation, technology-independent framework for server-side analyses that orchestrates jobs, schedules execution, and scales across runtimes. It brings the algorithm to the data and ensures reproducible results with data lineage. Merlin integrates seamlessly with ASAM ODS-based test data management.

 

 

#ASAM #ODS #TestData #Merlin #DataLineage #TDM #TestDataManagement #ASAMODS #HighQSoft

New Features and Improvements

Today, we released a number of improvements for our products

 

ASAMCommander: Catalog Editor

The release includes several enhancements for managing catalogs in ASAM ODS (Physical Dimensions, Units, Quantities, and groups). The  Catalog Editor provides comprehensive CRUD (Create, Read, Update, Delete) operations and additional features like transaction control, drag and drop functionality, and support for managing catalog elements and their instances.

 

 

HQL: Transaction Handling for Outer Sessions

This update allows creating transactions outside of HQL and requesting HQL to use them. This lifts the limitation of only one transaction per ASAM ODS session.

 

 

Merlin/SAM: New Validation Job Pipeline

A new Validation Job Pipeline runs custom Python scripts on imported data if certain criteria are met. The scripts can generate new parameters or measurements based on the data.

 

 

Merlin/SAM: Check New Job Pipeline for Filter Criteria

Introduces a Job Pipeline for checking newly imported measurements against filter criteria stored in the ASAM ODS database. The pipeline stages include applying filter criteria, copying processing results, and triggering validation.

 

 

Merlin/SAM : Adaptation to Python Repository

Implements a git storage for loading remote stage functions for Job Pipelines making it easier to manage and update scripts.

 

All updates enhance the functionality and flexibility of the Test Data Management Ecosystem providing robust tools for data validation, transaction handling, and catalog management.

 

#HighQSoft #Release #HQL #SoftwareUpdate #ASAMCommander #ASAMODS

What’s the Deal with ASAMCommander

 

Test Data Management can be a headache. Multiple proprietary formats, incompatible data structures, and a never-ending stream of new information can make it difficult, if not impossible, to turn raw data into actionable knowledge.
At HighQSoft, we specialize in wrangling your measurement data into something you can use today and in the future. We offer multiple products and solutions to help you organize and manage data, regardless of volume and format.

 

Our ASAMCommander is a test data management application based on the ASAM ODS standard (https://www.asam.net/standards/detail/ods/). As a modular web application, it comprises loosely coupled, functional units called modules that form a customizable experience for end-users, system and data administrators, or data analysts.

 

The basic version of ASAMCommander is an out-of-the-box application that provides all end-user use cases for data exploration (navigation, search, visualization), expert tool integration (e.g., AVL Concerto, Mathworks Matlab, NI DIAdem), and data exports (ASAM ATFx, CSV, ASAM MDF).

 

The Enterprise Edition of ASAMCommander is suited for Global Test Data Management solutions based on the AReS Libertas ODS6 Platform. System administration features include system logging, data lineage, and data retention. Our Merlin Analysis Framework provides all features for complete automation of analysis pipelines. ASAMCommander Enterprise allows customization, and new modules, features, and workflows are easy to add or integrate.

 

 

ASAMCommander 24.2: Enhanced Features and Improved User Experience

 

The ASAMCommander release 24.2 is now available at our download portal and includes:

 

AC-Mainframe

  • OAuth Authentication
    Support for OAuth authentication.
  • Icon Size Fix
    Ensured consistent icon sizes across all (module) cards.
  • Bug Fix
    An issue with highlighting and removing background color after clicking on a card and dropdown options was resolved.

AC-Navigator

  • Tree Search Fix
    The tree generated after ‘Search’ now closes appropriately, and the ‘load more’ button is only visible when more children are available.
  • Attributes Request
    Added the functionality to request attributes for application elements and display them in the Node Overview.
  • Copy to Clipboard
    Implemented a feature to copy attributes directly to the clipboard.
  • ASAM ODS Attributes
    Back-end support was added to show ASAM ODS attributes when selecting an ASAM ODS element.

AC-Logger

  • Increased Usability
    Developed UI to indicate the current page after searching or sorting in the logs table.

General Features

  • Extended CSV Exporter
    Integrated the support to export multiple measurements when exporting from a higher logical level.

The release contains various enhancements and updates for AC-MoMa, AC-Bookmarks, AC-Search, and AC-Merlin.

 

ASAMCommander works with any data model (ISO Safety, ASAM NVH, custom models), all domains (battery, powertrain, vehicle, ...), and any ASAM ODS server (AReS ODS Server, AVL Santorin).

 

#HighQSoft #TestDataManagement #MeasuredDataManagement #ASAMODS #ASAM #Release #Innovation

Enhancing Stability and User Experience

We are pleased to announce the release of ASAM Commander 24.1, packed with enhancements geared towards boosting stability and enhancing user experience across various modules, including some design upgrades throughout the entire application.

 

Web Application Enhancements

  • Commander: Now supports localization in both German and English, alongside fixes for reload/refresh functionality, and the addition of module highlighting in the Navbar for better navigation.
  • Navigator: Has undergone improvements, addressing issues with the Export feature within the Navigator Tree, refining the instance editor, and rectifying data type inconsistencies.
  • MoMa: Now includes Elapsed Time in its monitoring table, enhancing its functionality.
  • Bookmarks: We've upgraded the Bookmarks feature with keyword highlighting, improving search clarity.
  • Search: Fixed pagination issues within Advanced Search, ensuring smoother navigation through search results.
  • Merlin: We've resolved issues related to the Run feature in the HQL Job Type, ensuring seamless operation.
  • Logger: Say goodbye to hostname identification issues! We've enabled container identification by name, ensuring accurate logging and traceability.

 

#HighQSoft #SoftwareUpdate #DataManagement #ASAMCommander #Innovation

HighQSoft GmbH

Black-und-Decker-Straße 17b
D-65510 Idstein