Week 9: Remote Access to HPCC Systems Setup and Spraying Data files

Day 1, 2, and 3

After developing the knowledge base of wiktionary data, I started to access HPCC systems remotely. First, I tried to access the server remotely through Windows Subsystems for Linux (WSL) by following the guidelines: https://github.com/hpcc-systems/HPCC-Platform/wiki/Building-HPCC . While following step by step, I could able to install nodeJS for the Linux environment. However, when trying to install vcpkg I was having issues and was stopping installation in the middle. In the beginning, it was because my computer could not meet the installation requirement because of less memory space in the hard drive.

Then, I installed Oracle Virtual Box and created a virtual machine to complete building HPCC systems. Again, I found similar issues when trying to build multi-threading using CMake. Then, I tried accessing through a different laptop having Lixus operating system, but the multi-threading was still not running to 100% and I was having issues installing all required packages.

After that, as per the recommendation of my mentor, I again switched back to WSL. Even after taking the help from an expert in HPCC system, Michael Gardner, who is a software engineer III at LexisNexis, I couldn’t able to install vcpkg, and multithreading with –j4 was not still not running to 100%. With the help of StackOverflow, when I changed the threading to –j8 then the issue with multi-threading got resolved. However, I was still getting errors to build the HPCC system on WSL. In this way, after spending three days continuously working on accessing the HPCC system and failing to build it, my mentor developed a .deb package using which I could finally able to access HPCC systems by skipping all the steps of installing other packages.

Day 4 & 5

Spraying Data Files on HPCC system

After I could successfully be able to run HPCC system on WSL, I started HPCC system by running command cd/etc/init.d followed by sudo ./hpcc-init restart. By doing that, I could access ECL watch and by following the steps below one by one:

  • Start HPCC system using command on WSL
  • Open the http://127.0.0.1:8010/ to open the ECL Watch
  • Select files –> Landing zones
  • Click on upload and upload all files to spray
  • Click on BLOB and add target name and BLOB prefixClick on dropdown
  • click on “spray” button

When I clicked on spray button to spray my data files it failed spraying data files. Even after taking help of my mentor, David we couldn’t resolve it and I reached out to Michael Garderner and have been waiting for his response.

Leave a comment