Apache Zeppelin - How to use Helium framework in Apache Zeppelin - apache

From Zeppelin-0.7, Zeppelin started supporting Helium plugins/packages using Helium Framework. However, I am not able to view any of the plugin on Helium page (localhost:8080/#/helium). As per this JIRA, I placed sample Helium.json (available on s3) under /local-repo/helium-registry-cache. However, after that I got NPE while restarting Apache Zeppelin service.
I have tried Zeppelin 0.7 as well as Zeppelin 0.8.0 snaptshot versions. In particular, I want to use map Helium package - Helium-Map in Zeppelin note.
Can some one point me to any guide or documentation having detailed steps of using Helium package in Zeppelin? Any help would be greatly appreciated!

Zeppelin 0.7.x
Zeppelin 0.7.x doesn't support the online registry. In other words,
Zeppelin doesn't use helium.json. So you need to install each package by yourself.
clone the helium package what you want to install
modify the artifact value to the absolute path considering your local machine in helium-xxx.json
copy zeppelin-xxx.json into the $ZEPPELIN_HOME/helium directory (create if it doesn't exist yet)
restart Zeppelin and go to the localhost:8080/#/helium page, then install the package.
Zeppelin 0.8.0-SNAPSHOT
Zeppelin 0.8.0-SNAPSHOT supports the online registry. So you can install without any preparation.
But the NPE problem you've faced was fixed after https://github.com/apache/zeppelin/pull/2380.
So please git pull origin master and rebuild it :)
FYI, Now Zeppelin provides proxy functionality for helium. Refer https://github.com/apache/zeppelin/pull/2363

Related

firestore/google api get_document hangs sporadically with apache

I'm trying to deploy my django project with firebase backend.
But when I try to read document from firestore, document.get() hangs indefinitely. And it happens sporadically. The issue happens only with apache so far. I have tried with nginx, development server and django shell, but no issues. I have checked further into the firebase package and issue is happening at get_document. I couldn't go into further details.
Please find the versions of the packages used
firebase-admin 3.2.0
google-api-core 1.14.3
apache Apache/2.4.29
django 2.2.8
Ubuntu 18.04.3LTS 64bit 4.15.0-58-generic
python 3.6.9
Can you please help me solve the problem? Or could it be an issue with apache and need to raise an issue?
Thanks in advance!

Glusterfs client installation on ECS optimized Amazon Linux image

I am trying to use ECS optimized image (Amazon linux) and trying to install Glusterfs client on it.
Followed few documents like this internet but all are giving issue with repository. Unable to find the correct repo.
after tring yum install getting no package found error.
Please provide me some guidance to achieve this.

How to download Apache Zeppelin 0.8.0-SNAPSHOT

i want to install Apache Zeppelin 0.8.0-SNAPSHOT but cannot seem to find the proper link. I tried using https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/quickstart/install.html#downloading-binary-package but when i go to the "download page", it only has Zeppelin 0.7.3 files. Please guide me. Thanks!
You'll ending building it from source. It's the only way that I found: https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/setup/basics/how_to_build.html
Or wait until it be ready to be released =(

Apache version 2.2 and security vulnerabilities

A penetration test has recently identified that one of our RHEL(6.7) servers running Apache 2.2.15 is vulnerable on a number of points and needs to be updated to the latest version 2.4. I have run yum update and it says that there are no packages marked for update. I understand that I will need to download the updates manually. There are a few questions I have around the requirement to upgrade Apache.
I am up to date on the 2.2 version tree. Does this mean that any security patches made to version 2.4 will be back patched to version 2.2.X as well?
I am running PHP (version 5.3.3) and MySQL (version 5.1.73) - will these be affected by upgrading the Apache version (Google tells me that there is no problem on both fronts - but I thought I'd ask before I started down this route).
If you experts tell me that I have no other choice but to upgrade, then I'm planning on using the instruction set here: https://unix.stackexchange.com/questions/138899/centos-install-using-yum-apache-2-4
Thank you in advance for your advice.
You could download the 2.4 source code from the Apache site and compile it. There's a setting which will configure for RedHat:
--enable-layout=RedHat
This setting will configure the paths for executables, configuration files, libraries etc in one go.
The following should be a reasonable starting point for a configuration line:
sh ./configure --enable-layout=RedHat --enable-mods-shared=all
then perform a make and make install
Do the same with a newer version of PHP (5.3.29 is available in the "old downloads" section, but try a newer version. Check the changes first though) and your problems should be lessened. Finally, MySQL or MariaDB is available for download and compilation too
Obviously, try all of this on a test machine first and back everything up. Your test machine should be as close as possible to your production machine. If you use something like VirtualBox to try it, you can take a snapshot at each point of the process and rollback if something goes wrong

Accessing Hadoop clusters from eclipse

I just followed the Hadoop(0.20.2) installation tutorial and did the set up. I can run map reduce program on the cluster through eclipse. Now my problem is how can I connect to Hadoop clusters from my local system. Local system is windows 7 and I have installed eclipse plugin for Hadoop. I was trying to connect to Hadoop from my local system which is windows(My local system and Hadoop system are in same subnet). I got connection timed out error while connecting to Hadoop server.
In configuration files of Hadoop I have given actual IP addresses.
Not sure which step I have missed out?
I recently read, that the eclipse plugin won't work at all. But you can simply connect to your Cluster with the configuration keys:
mapred.job.tracker
fs.default.name
EDIT: here is a working version Apache Jira: Eclipse Plugin does not work with Eclipse Ganymede (3.4)