Does anyone know if it’s possible to automate data extraction from a Huawei system directly into Power BI? For example, by connecting to a database? I can extract data using iMaster MAE, but that’s not what I’m looking for.
With Ericsson, I connect to ENIQ and use SQL filters to get KPIs. I’d like to achieve the same functionality with Huawei.
What do you mean by saying you can do it from iMaster MAE?
As far as I know, it’s not possible to directly perform SQL queries on the Huawei OSS.
Using the Northbound interface, it should be possible to automatically generate counter files, which can then be stored on the TraceServer. From there, you could connect to the TraceServer, download the files, and process them.
However, querying directly with SQL doesn’t seem to be an option.
The Northbound interface is typically used by third-party tools to analyze Huawei data, such as configuration, inventory, alarms, and counters.
That said, unless you’re working directly with the operator, it might be challenging to gain all the necessary access permissions for the TraceServer and Northbound interface settings.
In iMaster MAE, I can create my formulas, export them to a CSV file, and then import them into Power BI. However, the goal is to avoid having to access iMaster every time to extract the data.
Ideally, I just want to open Power BI and refresh the graphics .
If there’s a function in MAE that allows setting up a rule to export data daily to a folder automatically, that would be perfect!
In the case of Huawei, it is not possible to directly query the MAE databases. However, it is possible to export everything that the MAE has, whether it is access or core, using the NBI (in the Huawei doc it appears how to configure this interface). In our case, we have the experience of having developed an ETL where we process all the csv files from the NBI and store all this data in parquet file datasets with hive-partitioning. This allows us to perform the same post-processing of the performance information as the rest of the providers (Ericsson, Nokia). Although it may seem a bit complicated, but all this can be set up in an environment as simple as a standalong PC.
Yes, automating data extraction from Huawei systems to Power BI is possible, but it depends on the specific Huawei system and the data access methods it supports. Here’s an overview of the steps you might take:
Check Huawei System’s Data Access Capabilities
Determine if the Huawei system provides APIs (REST, SOAP, etc.), database access, or export options (CSV, JSON, etc.).
Review Huawei’s documentation for integration options or contact their support team.
Set Up a Data Connection
API Integration: If APIs are available, you can use them to pull data periodically. Tools like Power Automate or custom scripts in Python or PowerShell can be used to fetch the data.
Database Connection: If the system uses a database, connect directly using Power BI’s database connectors (e.g., SQL, MySQL, Oracle).
File Exports: Automate file exports and schedule their upload to a location Power BI can access (like SharePoint or OneDrive).
Automate the Process
Use Power Automate, Python scripts, or third-party tools to fetch data from Huawei systems and save it in a format compatible with Power BI.
Schedule the data refresh in Power BI to align with the data extraction schedule.
Connect to Power BI
Use Power BI Desktop to connect to the data source.
Create reports and dashboards based on the extracted data.
Maintain and Monitor
Ensure the process is running smoothly and set up alerts for errors.
Regularly check for updates in Huawei systems or Power BI that might impact the integration.