Servers successfully started from gfsh but not connected to the locator - gemfire
I started a geode locator using gfsh and then started four servers using gfsh again but when I use the list members command, I only get the locator and not the servers.
gfsh>start locator --name=locate --port=10334
Starting a Geode Locator in C:\Users\Milin\locate...
.
Locator in C:\Users\Milin\locate on DESKTOP-EMRTT29.hitronhub.home[10334] as locate is currently online.
Process ID: 1616
Uptime: 3 minutes 31 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\locate\locate.log
JVM Arguments: -Dgemfire.enable-cluster-configuration=true -Dgemfire.load-cluster-configuration-from-dir=false -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
Successfully connected to: JMX Manager [host=DESKTOP-EMRTT29.hitronhub.home, port=1099]
Cluster configuration service is up and running.
gfsh>connect --locator=DESKTOP-EMRTT29.hitronhub.home[10334]
Already connected to: DESKTOP-EMRTT29.hitronhub.home[1099]
gfsh>list members
Member Count : 1
Name | Id
------ | -------------------------------------------------------------
locate | 192.168.0.82(locate:1616:locator)<ec><v0>:41000 [Coordinator]
gfsh>start server --name=serverA --server-port=41101
Starting a Geode Server in C:\Users\Milin\serverA...
.
Server in C:\Users\Milin\serverA on 192.168.0.82[41101] as serverA is currently online.
Process ID: 20920
Uptime: 20 minutes 13 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverA\serverA.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>start server --name=serverB --server-port=41102
Starting a Geode Server in C:\Users\Milin\serverB...
.
Server in C:\Users\Milin\serverB on DESKTOP-EMRTT29.hitronhub.home[41102] as serverB is currently online.
Process ID: 8908
Uptime: 20 minutes 17 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverB\serverB.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>start server --name=serverC --server-port=41103
Starting a Geode Server in C:\Users\Milin\serverC...
.
Server in C:\Users\Milin\serverC on DESKTOP-EMRTT29.hitronhub.home[41103] as serverC is currently online.
Process ID: 5940
Uptime: 20 minutes 15 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverC\serverC.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>start server --name=serverD --server-port=41104
Starting a Geode Server in C:\Users\Milin\serverD...
.
Server in C:\Users\Milin\serverD on DESKTOP-EMRTT29.hitronhub.home[41104] as serverD is currently online.
Process ID: 16548
Uptime: 20 minutes 12 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverD\serverD.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>list members
Member Count : 1
Name | Id
------ | -------------------------------------------------------------
locate | 192.168.0.82(locate:1616:locator)<ec><v0>:41000 [Coordinator]
I then also tried to start the servers by specifying the locator name (tried both the name and ID) but still the same results
gfsh>stop locator --name=locate
Stopping Locator running in C:\Users\Milin\locate on DESKTOP-EMRTT29.hitronhub.home[10334] as locate...
Process ID: 1616
Log File: C:\Users\Milin\locate\locate.log
....
No longer connected to DESKTOP-EMRTT29.hitronhub.home[1099].
No longer connected to DESKTOP-EMRTT29.hitronhub.home[1099].
gfsh>list members
Command 'list members' was found but is not currently available (type 'help' then ENTER to learn about this command)
gfsh>start locator --name=locate --port=10334
Starting a Geode Locator in C:\Users\Milin\locate...
..............................
Locator in C:\Users\Milin\locate on DESKTOP-EMRTT29.hitronhub.home[10334] as locate is currently online.
Process ID: 20936
Uptime: 19 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\locate\locate.log
JVM Arguments: -Dgemfire.enable-cluster-configuration=true -Dgemfire.load-cluster-configuration-from-dir=false -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
Successfully connected to: JMX Manager [host=DESKTOP-EMRTT29.hitronhub.home, port=1099]
Cluster configuration service is up and running.
gfsh>list members
Member Count : 1
Name | Id
------ | --------------------------------------------------------------
locate | 192.168.0.82(locate:20936:locator)<ec><v0>:41000 [Coordinator]
gfsh>connect
Already connected to: DESKTOP-EMRTT29.hitronhub.home[1099]
gfsh>describe member --name=locate
Name : locate
Id : 192.168.0.82(locate:20936:locator)<ec><v0>:41000
Host : DESKTOP-EMRTT29.hitronhub.home
Regions :
PID : 20936
Groups :
Used Heap : 259M
Max Heap : 1988M
Working Dir : C:\Users\Milin\locate
Log file : C:\Users\Milin\locate\locate.log
Locators : 192.168.0.82[10334]
gfsh>start server --name=serverA --server-port=41101 --locators=locate
Starting a Geode Server in C:\Users\Milin\serverA...
.
Server in C:\Users\Milin\serverA on 192.168.0.82[41101] as serverA is currently online.
Process ID: 20920
Uptime: 36 minutes 6 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverA\serverA.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>list members
Member Count : 1
Name | Id
------ | --------------------------------------------------------------
locate | 192.168.0.82(locate:20936:locator)<ec><v0>:41000 [Coordinator]
gfsh>start server --name=serverA --server-port=41101 --locators=192.168.0.82[10334]
Starting a Geode Server in C:\Users\Milin\serverA...
.
Server in C:\Users\Milin\serverA on 192.168.0.82[41101] as serverA is currently online.
Process ID: 20920
Uptime: 36 minutes 27 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverA\serverA.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>list members
Member Count : 1
Name | Id
------ | --------------------------------------------------------------
locate | 192.168.0.82(locate:20936:locator)<ec><v0>:41000 [Coordinator]
gfsh>start server --name=serverB --server-port=41102 --locators=192.168.0.82[10334]
Starting a Geode Server in C:\Users\Milin\serverB...
.
Server in C:\Users\Milin\serverB on DESKTOP-EMRTT29.hitronhub.home[41102] as serverB is currently online.
Process ID: 8908
Uptime: 36 minutes 42 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverB\serverB.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>list members
Member Count : 1
Name | Id
------ | --------------------------------------------------------------
locate | 192.168.0.82(locate:20936:locator)<ec><v0>:41000 [Coordinator]
gfsh>start server --name=serverC --server-port=41103 --locators=192.168.0.82[10334]
Starting a Geode Server in C:\Users\Milin\serverC...
.
Server in C:\Users\Milin\serverC on DESKTOP-EMRTT29.hitronhub.home[41103] as serverC is currently online.
Process ID: 5940
Uptime: 36 minutes 44 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverC\serverC.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
gfsh>start server --name=serverD --server-port=41104 --locators=192.168.0.82[10334]
Starting a Geode Server in C:\Users\Milin\serverD...
.
Server in C:\Users\Milin\serverD on DESKTOP-EMRTT29.hitronhub.home[41104] as serverD is currently online.
Process ID: 16548
Uptime: 36 minutes 44 seconds
Geode Version: 1.11.0
Java Version: 13.0.2
Log File: C:\Users\Milin\serverD\serverD.log
JVM Arguments: -Dgemfire.start-dev-rest-api=false -Dgemfire.use-cluster-configuration=true -XX:OnOutOfMemoryError=taskkill /F /PID %p -Dgemfire.launcher.registerSignalHandlers=true -Djava.awt.headless=true -Dsun.rmi.dgc.server.gcInterval=9223372036854775806
Class-Path: C:\apache-geode-1.11.0\lib\geode-core-1.11.0.jar;C:\apache-geode-1.11.0\lib\geode-dependencies.jar
I am not able to understand why this is happening. Also, I have never been able to get this start configuration right in one go anytime. Sometimes, the JMX Manager won't connect, sometimes the locator won't start, and it's just that I am working on a project and this consumes a lot of my time and I am not able to give time to the application part (which I am working on in Java).
Feel free to give advice
This should work out of the box just fine, there's something strange going on here... can you please make sure your servers are fully stopped and that you don't have any zombie processes before starting the cluster up again?.
I'm just wondering wether the servers were already started prior to starting the locator, basically because the output from the start server command states that the servers have been running for some time already...
Uptime: 20 minutes 12 seconds
Uptime: 36 minutes 44 seconds
Best regards.
Related
Can't backup db: libpq.so.5: cannot open shared object file: No such file or directory
Given: Linux Mint 20.3 DB Client: DBeaver 22.1.4 I try to backup my Postgresql's db (my_db) by DBeaver. But I get error: /run/user/1000/doc/65139af1/bin/pg_dump --verbose --host=localhost --port=5432 --username=postgres --format=p --file /home/my_user/dev/BACKUP/my_db_local/dump-my_db-202211161718.sql -n public my_db Task 'PostgreSQL dump' started at Wed Nov 16 17:18:29 EET 2022 /run/user/1000/doc/65139af1/bin/pg_dump: error while loading shared libraries: libpq.so.5: cannot open shared object file: No such file or directory Task 'PostgreSQL dump' finished at Wed Nov 16 17:18:29 EET 2022 2022-11-16 17:18:29.831 - IO error: Process failed (exit code = 127). See error log. 2022-11-16 17:18:29.832 - java.io.IOException: Process failed (exit code = 127). See error log. at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.validateErrorCode(AbstractNativeToolHandler.java:242) at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.executeProcess(AbstractNativeToolHandler.java:223) at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.doExecute(AbstractNativeToolHandler.java:262) at org.jkiss.dbeaver.tasks.nativetool.AbstractNativeToolHandler.lambda$0(AbstractNativeToolHandler.java:83) at org.jkiss.dbeaver.runtime.RunnableContextDelegate.lambda$0(RunnableContextDelegate.java:39) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:122)
Check if you have installed lib libpq.so.5 running the command: dconfig -p | grep libpq.so.5 If installed, something similar to this will appear.... libpq.so.5 (libc6,x86-64) => /lib/x86_64-linux-gnu/libpq.so.5 Make sure you are not using the flatpak version, I had the same problem with this version, if you are using it, uninstall and download the .deb package and install from there. https://dbeaver.io/download/
Making Dockerized Flask server concurrent
I have a Flask server that I'm running on AWS Fargate. My task has 2 vCPUs and 8 GB of memory. My server is only able to respond to one request at a time. If I run 2 API requests at the same, each that takes 7 seconds, the first request will take 7 seconds to return and the second will take 14 seconds to return. This is my Docker file (using this repo): FROM tiangolo/uwsgi-nginx-flask:python3.7 COPY ./requirements.txt requirements.txt RUN pip3 install --no-cache-dir -r requirements.txt RUN python3 -m spacy download en RUN apt-get update RUN apt-get install wkhtmltopdf -y RUN apt-get install poppler-utils -y RUN apt-get install xvfb -y COPY ./ /app I have the following config file: [uwsgi] module = main callable = app enable-threads = true These are my logs when I start the server: Checking for script in /app/prestart.sh Running script /app/prestart.sh Running inside /app/prestart.sh, you could add migrations to this file, e.g.: #! /usr/bin/env bash # Let the DB start sleep 10; # Run migrations alembic upgrade head /usr/lib/python2.7/dist-packages/supervisor/options.py:298: UserWarning: Supervisord is running as root and it is searching for its configuration file in default locations (including its current working directory); you probably want to specify a "-c" argument specifying an absolute path to a configuration file for improved security. 'Supervisord is running as root and it is searching ' 2019-10-05 06:29:53,438 CRIT Supervisor running as root (no user in config file) 2019-10-05 06:29:53,438 INFO Included extra file "/etc/supervisor/conf.d/supervisord.conf" during parsing 2019-10-05 06:29:53,446 INFO RPC interface 'supervisor' initialized 2019-10-05 06:29:53,446 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2019-10-05 06:29:53,446 INFO supervisord started with pid 1 2019-10-05 06:29:54,448 INFO spawned: 'nginx' with pid 9 2019-10-05 06:29:54,450 INFO spawned: 'uwsgi' with pid 10 [uWSGI] getting INI configuration from /app/uwsgi.ini [uWSGI] getting INI configuration from /etc/uwsgi/uwsgi.ini ;uWSGI instance configuration [uwsgi] cheaper = 2 processes = 16 ini = /app/uwsgi.ini module = main callable = app enable-threads = true ini = /etc/uwsgi/uwsgi.ini socket = /tmp/uwsgi.sock chown-socket = nginx:nginx chmod-socket = 664 hook-master-start = unix_signal:15 gracefully_kill_them_all need-app = true die-on-term = true show-config = true ;end of configuration *** Starting uWSGI 2.0.18 (64bit) on [Sat Oct 5 06:29:54 2019] *** compiled with version: 6.3.0 20170516 on 09 August 2019 03:11:53 os: Linux-4.14.138-114.102.amzn2.x86_64 #1 SMP Thu Aug 15 15:29:58 UTC 2019 nodename: ip-10-0-1-217.ec2.internal machine: x86_64 clock source: unix pcre jit disabled detected number of CPU cores: 2 current working directory: /app detected binary path: /usr/local/bin/uwsgi your memory page size is 4096 bytes detected max file descriptor number: 1024 lock engine: pthread robust mutexes thunder lock: disabled (you can enable it with --thunder-lock) uwsgi socket 0 bound to UNIX address /tmp/uwsgi.sock fd 3 uWSGI running as root, you can use --uid/--gid/--chroot options *** WARNING: you are running uWSGI as root !!! (use the --uid flag) *** Python version: 3.7.4 (default, Jul 13 2019, 14:20:24) [GCC 6.3.0 20170516] Python main interpreter initialized at 0x55e1e2b181a0 uWSGI running as root, you can use --uid/--gid/--chroot options *** WARNING: you are running uWSGI as root !!! (use the --uid flag) *** python threads support enabled your server socket listen backlog is limited to 100 connections your mercy for graceful operations on workers is 60 seconds mapped 1239640 bytes (1210 KB) for 16 cores *** Operational MODE: preforking *** 2019-10-05 06:29:55,483 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2019-10-05 06:29:55,484 INFO success: uwsgi entered RUNNING state, process has stayed up for > than 1 seconds (startsecs)
Apache MINA - stuck on SSL connection
I am having troubles with Apache MINA core library. When I deploy my application to a remote server some of the requests are not processed (around 2%). It looks like there might be a problem with SSL. Log tail: http://pastebin.com/48bwWsjs When request is not being processed, it is always stuck on the: org.apache.mina.filter.ssl.SslFilter - Session Server[40](ssl...): Processing the SSL Data Did something similar happened to any of you? I tried Apache-mina 2.0.7 and 2.0.16 Env: bash-4.2$ java -version java version "1.8.0_111" Java(TM) SE Runtime Environment (build 1.8.0_111-b14) Java HotSpot(TM) 64-Bit Server VM (build 25.111-b14, mixed mode) bash-4.2$ uname -a Linux 8d9ad913fa03 4.4.39-34.54.amzn1.x86_64 #1 SMP Fri Dec 30 19:11:28 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux Thanks any help!
Pig Processing log file using
I have following logs : Can any one tell me how can I processes it using PigLatin ? ** SYSTEM IP:192.168.68.78 Distro info:Red Hat Enterprise Linux Server release 6.6 (Santiago) Kernel:Linux bugzilla-blr-in 2.6.32-504.16.2.el6.x86_64 #1 SMP Tue Mar 10 17:01:00 EDT 2015 x86_64 x86_64 x86_64 GNU/Linux Uptime:12:27:42 up 8 days, 17:57, 0 users, load average: 0.00, 0.00, 0.00 Memory:Total:1869Mb Memory:Used:1567Mb Memory:Free:302Mb Swap:Total:1999Mb Swap:Used:0Mb Swap:Free: 1999Mb Architecture:x86_64 Processor:0:Intel(R) Xeon(R) CPU E5-2640 0 # 2.50GHz Date:Wed Jun 29 12:27:42 IST 2016 SCRIPT USER User:aimsadm (uid:503) Groups:aimsadm Working dir:/home/aimsadm Home dir:/home/aimsadm NETWORK DETAILS Hostname:bugzilla-blr-in IP ( ):127.0.0.1/8 IP (eth0):192.168.68.78/24 Gateway:192.168.68.1 Name Server:8.8.8.8 Name Server:192.168.68.80 LIST OF USERS:sdudam,sudutha,djegathesa,aimsadm,krishnang, CLAMD STATUS: CLAM AV service is stopped or not installed NAGIOS STATUS: Nagios service is running OSSEC STATUS: Ossec service is stopped or not installed NTPD STATUS: NTP service is running HARDENING STATUS:Hardening Done AD INTEGRATION STATUS:AD Integration Not Done HARDWARE/PLATFORM DETAILS Hardware Platform:64Bit Hardware Info :DMI 2.3 present. DMI: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090006 05/23/2012 OS DETAILS Red Hat Enterprise Linux Server release 6.6 (Santiago) Linux bugzilla-blr-in 2.6.32-504.16.2.el6.x86_64 #1 SMP Tue Mar 10 17:01:00 EDT 2015 x86_64 x86_64 x86_64 GNU/Linux CPU INFO model name : Intel(R) Xeon(R) CPU E5-2640 0 # 2.50GHz MEMORY INFO MemTotal: 1914776 kB RAM:1 GB HARD DISK DETAILS MOUNT DETAILS Filesystem:/dev/mapper/vg_bugzillablrin-LogVol00,Type:ext4,Total Size:22G,Used:2.4G,Avail:19G,Use%:12%,Mounted on:/ Filesystem:tmpfs,Type:tmpfs,Total Size:981M,Used:0,Avail:981M,Use%:0%,Mounted on:/dev/shm Filesystem:/dev/sda1,Type:ext4,Total Size:297M,Used:95M,Avail:186M,Use%:34%,Mounted on:/boot Filesystem:/dev/mapper/vg_bugzillablrin-LogVol01,Type:ext4,Total Size:21G,Used:5.8G,Avail:14G,Use%:30%,Mounted on:/var LSBLK OUTPUT NAME:sr0, MAJ:MIN:11:0,RM:1,SIZE:1024M,RO:0,TYPE:rom,MOUNTPOINT:: NAME:sda, MAJ:MIN:8:0,RM:0,SIZE:60G,RO:0,TYPE:disk,MOUNTPOINT:: NAME:sda1, MAJ:MIN:8:1,RM:0,SIZE:300M,RO:0,TYPE:part,MOUNTPOINT::/boot NAME:sda2, MAJ:MIN:8:2,RM:0,SIZE:59.7G,RO:0,TYPE:part,MOUNTPOINT:: RUNNING SERVICES auditd running... crond running... messagebus running... nrpe running... ntpd running... rhnsd running... rhsmcertd running... rpcbind running... openssh-daemon running... ** SYSTEM IP:192.168.68.35 Distro info:CentOS release 6.6 (Final) Kernel:Linux altifin-ci-app 2.6.32-504.16.2.el6.x86_64 #1 SMP Wed Apr 22 06:48:29 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux Uptime:12:28:06 up 48 days, 20:31, 0 users, load average: 0.00, 0.00, 0.00 Memory:Total:11903Mb Memory:Used:1277Mb Memory:Free:10625Mb Swap:Total:8191Mb Swap:Used:0Mb Swap:Free: 8191Mb Architecture:x86_64 Processor:0:Intel(R) Xeon(R) CPU E5-2650 v2 # 2.60GHz Processor:1:Intel(R) Xeon(R) CPU E5-2650 v2 # 2.60GHz Date:Wed Jun 29 12:28:06 IST 2016 SCRIPT USER User:aimsadm (uid:509) Groups:aimsadm Working dir:/home/aimsadm Home dir:/home/aimsadm NETWORK DETAILS Hostname:altifin-ci-app IP (lo):127.0.0.1/8 IP (eth0):192.168.68.35/24 Gateway:192.168.68.1 Name Server:192.168.68.10 Name Server:192.168.68.4 LIST OF USERS:altipay,aramesh,sdudam,nagios,kpankaj,sudutha,miyappan,skosanam,djegathesa,aimsadm, CLAMD STATUS: CLAM AV service is stopped or not installed NAGIOS STATUS: Nagios service is running OSSEC STATUS: Ossec service is stopped or not installed NTPD STATUS: NTP service is running HARDENING STATUS:Hardening Done AD INTEGRATION STATUS:AD Integration Not Done HARDWARE/PLATFORM DETAILS Hardware Platform:64Bit Hardware Info :DMI 2.3 present. DMI: Microsoft Corporation Virtual Machine/Virtual Machine, BIOS 090006 05/23/2012 OS DETAILS CentOS release 6.6 (Final) Linux altifin-ci-app 2.6.32-504.16.2.el6.x86_64 #1 SMP Wed Apr 22 06:48:29 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux CPU INFO model name : Intel(R) Xeon(R) CPU E5-2650 v2 # 2.60GHz model name : Intel(R) Xeon(R) CPU E5-2650 v2 # 2.60GHz MEMORY INFO MemTotal: 12189032 kB RAM:11 GB HARD DISK DETAILS MOUNT DETAILS Filesystem:/dev/mapper/vg_altifinci-LogVol01,Type:ext4,Total Size:203G,Used:80G,Avail:113G,Use%:42%,Mounted on:/ Filesystem:tmpfs,Type:tmpfs,Total Size:6.3G,Used:0,Avail:6.3G,Use%:0%,Mounted on:/dev/shm Filesystem:/dev/sda1,Type:ext4,Total Size:500M,Used:64M,Avail:410M,Use%:14%,Mounted on:/boot LSBLK OUTPUT NAME:sr0, MAJ:MIN:11:0,RM:1,SIZE:1024M,RO:0,TYPE:rom,MOUNTPOINT:: NAME:sda, MAJ:MIN:8:0,RM:0,SIZE:200G,RO:0,TYPE:disk,MOUNTPOINT:: NAME:sda1, MAJ:MIN:8:1,RM:0,SIZE:500M,RO:0,TYPE:part,MOUNTPOINT::/boot NAME:sda2, MAJ:MIN:8:2,RM:0,SIZE:199.5G,RO:0,TYPE:part,MOUNTPOINT:: RUNNING SERVICES abrtd running... abrt-dump-oops running... acpid running... atd running... auditd running... automount running... crond running... cupsd running... hald running... mcelog running... messagebus running... MySQL but rpc.statd running... nrpe running... ntpd running... rpcbind running... openssh-daemon running...
Yes. There is way. Let me explain this. Though the given sample data falls into the category of 'unstructured', we always look for 'some thing' in it. Having said that we look for a pattern, say line or lines having the required data you are looking into! To achieve this we need to identify the 'pattern' from the sample data and use appropriate 'RegEx' (regular expression) to pull it. Also, Pig comes with built-in jar 'piggybank' to support various pre-defined file formats including unstructured one like you said.Try with 'RegExLoader' class that is part of the below package from PIG's piggybank!!! (Package org.apache.pig.piggybank.storage) https://pig.apache.org/docs/r0.15.0/api/ Also, let all know the exact output you are looking into.
After sonarqube upgrade 5.2 -> 5.6, WebServer is not operational any more
I'm using WindowsServer2008 and MySql 5.6.31. I wanted to upgrade SonarQube from version 5.2 to 5.6. After starting SonarQube the log-file shows the below lines. Everything should be finde, except the WebServer doesn't become operational: INFO ce[o.s.c.a.WebServerWatcherImpl] Waiting for Web Server to be operational... INFO ce[o.s.c.a.WebServerWatcherImpl] Still waiting for WebServer... When I try to reach the WebServer in the browser, I get the message from ApacheTomcat: HTTP Status 404 - /sessions/new type Status report message /sessions/new description The requested resource is not available. Apache Tomcat/8.0.30 Does anyone know why the WebServer doesn't become operational? Wrapper Manager: JVM #1 Running a 64-bit JVM. Wrapper Manager: Registering shutdown hook Wrapper Manager: Using wrapper Load native library. One or more attempts may fail if platform specific libraries do not exist. Loading native library failed: wrapper-windows-x86-64.dll Cause: java.lang.UnsatisfiedLinkError: no wrapper-windows-x86-64 in java.library.path Loaded native library: wrapper.dll Calling native initialization method. Initializing WrapperManager native library. Java Executable: C:\ProgramData\Oracle\Java\javapath\java.exe Windows version: 6.1.7601 Java Version : 1.8.0_91-b15 Java HotSpot(TM) 64-Bit Server VM Java VM Vendor : Oracle Corporation Control event monitor thread started. Startup runner thread started. WrapperManager.start(org.tanukisoftware.wrapper.WrapperSimpleApp#38af3868, args[]) called by thread: main Communications runner thread started. Open socket to wrapper...Wrapper-Connection Opened Socket from 31000 to 32000 Send a packet KEY : fnnZL60VqJstVqYQ handleSocket(Socket[addr=/127.0.0.1,port=32000,localport=31000]) Received a packet LOW_LOG_LEVEL : 1 Wrapper Manager: LowLogLevel from Wrapper is 1 Received a packet PING_TIMEOUT : 200 PingTimeout from Wrapper is 200000 Received a packet PROPERTIES : (Property Values) Received a packet START : start calling WrapperListener.start() Waiting for WrapperListener.start runner thread to complete. WrapperListener.start runner thread started. WrapperSimpleApp: start(args) Will wait up to 2 seconds for the main method to complete. WrapperSimpleApp: invoking main method 2016.07.28 13:48:38 INFO app[o.s.a.AppFileSystem] Cleaning or creating temp directory D:\SonarQube\sonarqube-5.6\temp 2016.07.28 13:48:38 INFO app[o.s.p.m.JavaProcessLauncher] Launch process[es]: C:\Program Files\Java\jre1.8.0_91\bin\java -Djava.awt.headless=true -Xmx1G -Xms256m -Xss256k -Djava.net.preferIPv4Stack=true -XX:+UseParNewGC -XX:+UseConcMarkSweepGC -XX:CMSInitiatingOccupancyFraction=75 -XX:+UseCMSInitiatingOccupancyOnly -XX:+HeapDumpOnOutOfMemoryError -Djava.io.tmpdir=D:\SonarQube\sonarqube-5.6\temp -javaagent:C:\Program Files\Java\jre1.8.0_91\lib\management-agent.jar -cp ./lib/common/;./lib/search/ org.sonar.search.SearchServer D:\SonarQube\sonarqube-5.6\temp\sq-process6103713257744114100properties Send a packet START_PENDING : 5000 Send a packet START_PENDING : 5000 WrapperSimpleApp: start(args) end. Main Completed=false, exitCode=null WrapperListener.start runner thread stopped. returned from WrapperListener.start() Send a packet STARTED : Startup runner thread stopped. Received a packet PING : ping Send a packet PING : ok 2016.07.28 13:48:41 INFO es[o.s.p.ProcessEntryPoint] Starting es 2016.07.28 13:48:41 INFO es[o.s.s.EsSettings] Elasticsearch listening on 127.0.0.1:9001 2016.07.28 13:48:42 INFO es[o.elasticsearch.node] [sonar-1469706518062] version[1.7.5], pid[3788], build[00f95f4/2016-02-02T09:55:30Z] 2016.07.28 13:48:42 INFO es[o.elasticsearch.node] [sonar-1469706518062] initializing ... 2016.07.28 13:48:42 INFO es[o.e.plugins] [sonar-1469706518062] loaded [], sites [] 2016.07.28 13:48:43 INFO es[o.elasticsearch.env] [sonar-1469706518062] using [1] data paths, mounts [[Data (D:)]], net usable_space [29.5gb], net total_space [249.9gb], types [NTFS] Received a packet PING : ping Send a packet PING : ok 2016.07.28 13:48:46 WARN es[o.e.bootstrap] JNA not found. native methods will be disabled. 2016.07.28 13:48:47 INFO es[o.elasticsearch.node] [sonar-1469706518062] initialized 2016.07.28 13:48:47 INFO es[o.elasticsearch.node] [sonar-1469706518062] starting ... 2016.07.28 13:48:47 INFO es[o.e.transport] [sonar-1469706518062] bound_address {inet[/127.0.0.1:9001]}, publish_address {inet[/127.0.0.1:9001]} 2016.07.28 13:48:47 INFO es[o.e.discovery] [sonar-1469706518062] sonarqube/NDLYofdsQU6dCANZLN0p9w Received a packet PING : ping Send a packet PING : ok 2016.07.28 13:48:50 INFO es[o.e.cluster.service] [sonar-1469706518062] new_master [sonar-1469706518062][NDLYofdsQU6dCANZLN0p9w][DEERLA7LRUD10A][inet[/127.0.0.1:9001]]{rack_id=sonar-1469706518062}, reason: zen-disco-join (elected_as_master) 2016.07.28 13:48:50 INFO es[o.elasticsearch.node] [sonar-1469706518062] started 2016.07.28 13:48:50 INFO es[o.e.gateway] [sonar-1469706518062] recovered [0] indices into cluster_state 2016.07.28 13:48:51 INFO app[o.s.p.m.Monitor] Process[es] is up 2016.07.28 13:48:51 INFO app[o.s.p.m.JavaProcessLauncher] Launch process[web]: C:\Program Files\Java\jre1.8.0_91\bin\java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Djruby.management.enabled=false -Djruby.compile.invokedynamic=false -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Djava.net.preferIPv4Stack=true -Djava.io.tmpdir=D:\SonarQube\sonarqube-5.6\temp -javaagent:C:\Program Files\Java\jre1.8.0_91\lib\management-agent.jar -cp ./lib/common/;./lib/server/;D:\SonarQube\sonarqube-5.6\lib\jdbc\mysql\mysql-connector-java-5.1.35.jar org.sonar.server.app.WebServer D:\SonarQube\sonarqube-5.6\temp\sq-process200048299209178132properties Received a packet PING : ping Send a packet PING : ok 2016.07.28 13:48:55 TRACE web[o.s.p.Lifecycle] tryToMoveTo from INIT to STARTING => true 2016.07.28 13:48:55 INFO web[o.s.p.ProcessEntryPoint] Starting web 2016.07.28 13:48:56 INFO web[o.s.s.a.TomcatContexts] Webapp directory: D:\SonarQube\sonarqube-5.6\web 2016.07.28 13:48:56 INFO web[o.a.c.h.Http11NioProtocol] Initializing ProtocolHandler ["http-nio-xxx.xxx.x.xxx-xxxx"] 2016.07.28 13:48:56 INFO web[o.a.t.u.n.NioSelectorPool] Using a shared selector for servlet write/read Received a packet PING : ping Send a packet PING : ok 2016.07.28 13:48:57 INFO web[o.a.c.h.Http11NioProtocol] Starting ProtocolHandler ["http-nio-xxx.xxx.x.xxx-xxxx"] 2016.07.28 13:48:57 INFO web[o.s.s.a.TomcatAccessLog] Web server is started 2016.07.28 13:48:57 INFO web[o.s.s.a.EmbeddedTomcat] HTTP connector enabled on port 9000 2016.07.28 13:48:57 TRACE web[o.s.p.Lifecycle] tryToMoveTo from STARTING to STARTED => true 2016.07.28 13:48:58 INFO app[o.s.p.m.Monitor] Process[web] is up 2016.07.28 13:48:58 INFO app[o.s.p.m.JavaProcessLauncher] Launch process[ce]: C:\Program Files\Java\jre1.8.0_91\bin\java -Djava.awt.headless=true -Dfile.encoding=UTF-8 -Xmx512m -Xms128m -XX:+HeapDumpOnOutOfMemoryError -Djava.net.preferIPv4Stack=true -Djava.io.tmpdir=D:\SonarQube\sonarqube-5.6\temp -javaagent:C:\Program Files\Java\jre1.8.0_91\lib\management-agent.jar -cp ./lib/common/;./lib/server/;./lib/ce/*;D:\SonarQube\sonarqube-5.6\lib\jdbc\mysql\mysql-connector-java-5.1.35.jar org.sonar.ce.app.CeServer D:\SonarQube\sonarqube-5.6\temp\sq-process346661778793077863properties 2016.07.28 13:48:59 TRACE ce[o.s.p.Lifecycle] tryToMoveTo from INIT to STARTING => true 2016.07.28 13:48:59 INFO ce[o.s.p.ProcessEntryPoint] Starting ce 2016.07.28 13:48:59 INFO ce[o.s.c.a.WebServerWatcherImpl] Waiting for Web Server to be operational... 2016.07.28 13:49:00 INFO ce[o.s.c.a.WebServerWatcherImpl] Still waiting for WebServer... Received a packet PING : ping Send a packet PING : ok 2016.07.28 13:49:02 INFO ce[o.s.c.a.WebServerWatcherImpl] Still waiting for WebServer... Received a packet PING : ping Send a packet PING : ok
There should be a line on the log like this 2017.01.08 23:12:11 WARN web[o.s.s.p.DatabaseServerCompatibility] Database must be upgraded. Please backup database and browse /setup The server is waiting the user to go to the /setup page to upgrade the DB before continue.
As per below log line WARN web[o.s.s.p.DatabaseServerCompatibility] Database must be upgraded. Please backup database and browse /setup Go to http://<sonar-host>:9000/<context path>/setup and click on Migrate button. After successful migration, your server will ready to use.