Automating Data Extraction from Huawei Systems to Power BI: Is It Possible?

Hello Experts;

Does anyone know if it’s possible to automate data extraction from a Huawei system directly into Power BI? For example, by connecting to a database? I can extract data using iMaster MAE, but that’s not what I’m looking for.

With Ericsson, I connect to ENIQ and use SQL filters to get KPIs. I’d like to achieve the same functionality with Huawei.

What do you mean by saying you can do it from iMaster MAE?

As far as I know, it’s not possible to directly perform SQL queries on the Huawei OSS.

Using the Northbound interface, it should be possible to automatically generate counter files, which can then be stored on the TraceServer. From there, you could connect to the TraceServer, download the files, and process them.

However, querying directly with SQL doesn’t seem to be an option.

The Northbound interface is typically used by third-party tools to analyze Huawei data, such as configuration, inventory, alarms, and counters.

That said, unless you’re working directly with the operator, it might be challenging to gain all the necessary access permissions for the TraceServer and Northbound interface settings.

In iMaster MAE, I can create my formulas, export them to a CSV file, and then import them into Power BI. However, the goal is to avoid having to access iMaster every time to extract the data.

Ideally, I just want to open Power BI and refresh the graphics :laughing:.

If there’s a function in MAE that allows setting up a rule to export data daily to a folder automatically, that would be perfect!

Extract the PM files, parse them, and build your own SQL database. Each time a new file appears in the NBI, repeat the process.

Good luck managing and storing all that data!

I don’t know how :sweat_smile:

It’s not easy - that’s why tools like iMaster MAE, ENIQ, and similar systems exist to handle this complexity for you. :blush:

1 Like

Hello

We do that in CellApps tool from cellsight. We have Nokia, Ericsson, Samsung (4G/5G) and Huawei for 3G.

BTW I believe on the Huawei system the xml counter files are in

/opt/oss/server/var/fileint/pm

or use a tool like cellapps :slight_smile:

In the case of Huawei, it is not possible to directly query the MAE databases. However, it is possible to export everything that the MAE has, whether it is access or core, using the NBI (in the Huawei doc it appears how to configure this interface). In our case, we have the experience of having developed an ETL where we process all the csv files from the NBI and store all this data in parquet file datasets with hive-partitioning. This allows us to perform the same post-processing of the performance information as the rest of the providers (Ericsson, Nokia). Although it may seem a bit complicated, but all this can be set up in an environment as simple as a standalong PC.

I don’t think that’s possible through the MAE; perhaps you could use the PRS instead.

Here:

Evaluation > Maintenance > Schedule Report

I’ve never used it before - let us know how it works out!

Yes, you can schedule a report to have the data sent to your email server or any designated location where you want to store the file.

first check the Power BI version to make sure it is compatible. Huawei has an API that facilitates the connection to the latest generation databases.

Yes, it is totally possible, you can export the scheduled reports to your FTP server.

Can you please provide more details how we can implement it

Yes, automating data extraction from Huawei systems to Power BI is possible, but it depends on the specific Huawei system and the data access methods it supports. Here’s an overview of the steps you might take:

  1. Check Huawei System’s Data Access Capabilities
  • Determine if the Huawei system provides APIs (REST, SOAP, etc.), database access, or export options (CSV, JSON, etc.).
  • Review Huawei’s documentation for integration options or contact their support team.
  1. Set Up a Data Connection
  • API Integration: If APIs are available, you can use them to pull data periodically. Tools like Power Automate or custom scripts in Python or PowerShell can be used to fetch the data.
  • Database Connection: If the system uses a database, connect directly using Power BI’s database connectors (e.g., SQL, MySQL, Oracle).
  • File Exports: Automate file exports and schedule their upload to a location Power BI can access (like SharePoint or OneDrive).
  1. Automate the Process
  • Use Power Automate, Python scripts, or third-party tools to fetch data from Huawei systems and save it in a format compatible with Power BI.
  • Schedule the data refresh in Power BI to align with the data extraction schedule.
  1. Connect to Power BI
  • Use Power BI Desktop to connect to the data source.
  • Create reports and dashboards based on the extracted data.
  1. Maintain and Monitor
  • Ensure the process is running smoothly and set up alerts for errors.
  • Regularly check for updates in Huawei systems or Power BI that might impact the integration.
1 Like