I am trying to reindex one of my indexes deleting old data and full-index. When i try to do this. The node immediately goes down, i cannot run nodetool commands such as nodetool status, nodetool tpstats.Also, i cannot see CPU, disk, network. The node is idle. When i look at the processes on my machine, I can see that is cassandra process.
my schema.xml like that
<field indexed="true" name="key1" stored="true" type="StrField"/>
<field indexed="true" name="key2" stored="true" type="StrField"/>
<field indexed="true" name="key3" stored="true" type="StrField"/>
<field indexed="true" name="key4" stored="true" type="TrieIntField"/>
<field indexed="true" name="key5" stored="true" type="StrField"/>
<field indexed="true" name="key6" stored="true" type="TrieIntField"/>
<field indexed="true" name="key7" stored="true" type="StrField"/>
<field indexed="true" name="key8" stored="true" type="StrField"/>
<field indexed="true" name="key9" stored="true" type="StrField"/>
<field indexed="true" name="key10" stored="true" type="StrField"/>
<field indexed="true" name="key11" stored="true" type="StrField"/>
<field indexed="true" name="key12" stored="true" type="TrieDateField"/>
<field indexed="true" name="key13" stored="true" type="StrField"/>
<field indexed="true" name="key14" stored="true" type="StrField"/>
<field indexed="true" name="key15" stored="true" type="StrField"/>
<field indexed="true" name="key16" stored="true" type="StrField"/>
<field indexed="true" name="key17" stored="true" type="StrField"/>
<field indexed="true" name="key18" stored="true" type="StrField"/>
<field indexed="true" name="key19" stored="true" type="StrField"/>
<field indexed="true" name="key20" stored="true" type="TrieIntField"/>
<field indexed="true" name="key21" stored="true" type="TrieIntField"/>
<field indexed="true" name="col1" stored="true" type="TrieDoubleField"/>
<field indexed="true" name="col2" stored="true" type="TrieDoubleField"/>
<field indexed="true" name="col3" stored="true" type="TrieLongField"/>
<uniqueKey>(key1 ... key21)</uniqueKey>
java settings
<pre>
-javaagent:/usr/share/dse/cassandra/lib/jamm-0.3.0.jar
-XX:+UseThreadPriorities
-XX:ThreadPriorityPolicy=42
-Xms32G
-Xmx32G
-XX:+HeapDumpOnOutOfMemoryError
-XX:HeapDumpPath=/disk1/cassandra/dumps/cassandra-1477648403-pid42715.hprof
-Xss512k
-XX:+AlwaysPreTouch
-XX:-UseBiasedLocking
-XX:StringTableSize=1000003
-XX:+UseTLAB
-XX:+ResizeTLAB
-XX:CompileCommandFile=/etc/dse//cassandra/hotspot_compiler
-XX:+UseG1GC
-XX:G1RSetUpdatingPauseTimePercent=5
-XX:MaxGCPauseMillis=200
-XX:ParallelGCThreads=16 changed defaults settings
-XX:ConcGCThreads=16 changed defaults settings
-XX:InitiatingHeapOccupancyPercent=40
-XX:+PrintGCDetails
-XX:+PrintGCDateStamps
-XX:+PrintHeapAtGC
-XX:+PrintTenuringDistribution
-XX:+PrintGCApplicationStoppedTime
-XX:+PrintPromotionFailure
-XX:PrintFLSStatistics=1
-Xloggc:/var/log/cassandra/gc-1477648403.log
-Xloggc:/var/log/cassandra/gc.log
-XX:+UseGCLogFileRotation
-XX:NumberOfGCLogFiles=10
-XX:GCLogFileSize=10M
The pause times when i started the re-index
2016-10-27T22:25:36.381+0200: 16133.424: Total time for which application threads were stopped: 28.6449951 seconds, Stopping threads took: 0.0000877 seconds
2016-10-27T22:25:36.396+0200: 16133.440: Total time for which application threads were stopped: 0.0152024 seconds, Stopping threads took: 0.0001349 seconds
2016-10-27T22:25:36.409+0200: 16133.452: Total time for which application threads were stopped: 0.0123116 seconds, Stopping threads took: 0.0000487 seconds
2016-10-27T22:25:50.745+0200: 16147.788: Total time for which application threads were stopped: 14.3359300 seconds, Stopping threads took: 0.0000616 seconds
2016-10-27T22:25:50.761+0200: 16147.804: Total time for which application threads were stopped: 0.0159109 seconds, Stopping threads took: 0.0001860 seconds
2016-10-27T22:25:50.774+0200: 16147.818: Total time for which application threads were stopped: 0.0136620 seconds, Stopping threads took: 0.0000423 seconds
2016-10-27T22:26:04.853+0200: 16161.897: Total time for which application threads were stopped: 14.0787608 seconds, Stopping threads took: 0.0000590 seconds
2016-10-27T22:26:04.871+0200: 16161.914: Total time for which application threads were stopped: 0.0171435 seconds, Stopping threads took: 0.0001669 seconds
2016-10-27T22:26:18.949+0200: 16175.993: Total time for which application threads were stopped: 14.0786946 seconds, Stopping threads took: 0.0000607 seconds
2016-10-27T22:26:18.968+0200: 16176.011: Total time for which application threads were stopped: 0.0184226 seconds, Stopping threads took: 0.0002338 seconds
2016-10-27T22:26:18.979+0200: 16176.022: Total time for which application threads were stopped: 0.0108393 seconds, Stopping threads took: 0.0000463 seconds
2016-10-27T22:26:33.210+0200: 16190.254: Total time for which application threads were stopped: 14.2314474 seconds, Stopping threads took: 0.0000724 seconds
2016-10-27T22:26:33.228+0200: 16190.272: Total time for which application threads were stopped: 0.0172137 seconds, Stopping threads took: 0.0000845 seconds
2016-10-27T22:26:33.243+0200: 16190.286: Total time for which application threads were stopped: 0.0147185 seconds, Stopping threads took: 0.0000770 seconds
2016-10-27T22:26:47.315+0200: 16204.358: Total time for which application threads were stopped: 14.0715678 seconds, Stopping threads took: 0.0001087 seconds
2016-10-27T22:26:47.335+0200: 16204.379: Total time for which application threads were stopped: 0.0203852 seconds, Stopping threads took: 0.0002385 seconds
2016-10-27T22:26:47.347+0200: 16204.391: Total time for which application threads were stopped: 0.0120962 seconds, Stopping threads took: 0.0001291 seconds
2016-10-27T22:27:01.590+0200: 16218.633: Total time for which application threads were stopped: 14.2425348 seconds, Stopping threads took: 0.0000658 seconds
2016-10-27T22:27:01.608+0200: 16218.652: Total time for which application threads were stopped: 0.0175375 seconds, Stopping threads took: 0.0002150 seconds
2016-10-27T22:27:01.622+0200: 16218.665: Total time for which application threads were stopped: 0.0134276 seconds, Stopping threads took: 0.0000305 seconds
2016-10-27T22:27:15.820+0200: 16232.863: Total time for which application threads were stopped: 14.1976605 seconds, Stopping threads took: 0.0000580 seconds
2016-10-27T22:27:15.839+0200: 16232.883: Total time for which application threads were stopped: 0.0181183 seconds, Stopping threads took: 0.0001094 seconds
2016-10-27T22:27:15.854+0200: 16232.898: Total time for which application threads were stopped: 0.0146620 seconds, Stopping threads took: 0.0000391 seconds
2016-10-27T22:27:29.911+0200: 16246.954: Total time for which application threads were stopped: 14.0568599 seconds, Stopping threads took: 0.0000689 seconds
2016-10-27T22:27:29.930+0200: 16246.973: Total time for which application threads were stopped: 0.0184539 seconds, Stopping threads took: 0.0002259 seconds
2016-10-27T22:27:29.942+0200: 16246.985: Total time for which application threads were stopped: 0.0120611 seconds, Stopping threads took: 0.0000643 seconds
2016-10-27T22:27:44.239+0200: 16261.282: Total time for which application threads were stopped: 14.2971941 seconds, Stopping threads took: 0.0000682 seconds
2016-10-27T22:27:44.256+0200: 16261.299: Total time for which application threads were stopped: 0.0165530 seconds, Stopping threads took: 0.0001018 seconds
2016-10-27T22:27:44.268+0200: 16261.312: Total time for which application threads were stopped: 0.0126950 seconds, Stopping threads took: 0.0000236 seconds
2016-10-27T22:27:58.407+0200: 16275.451: Total time for which application threads were stopped: 14.1388198 seconds, Stopping threads took: 0.0000495 seconds
2016-10-27T22:27:58.426+0200: 16275.470: Total time for which application threads were stopped: 0.0189899 seconds, Stopping threads took: 0.0001773 seconds
2016-10-27T22:27:58.437+0200: 16275.480: Total time for which application threads were stopped: 0.0104863 seconds, Stopping threads took: 0.0000825 seconds
2016-10-27T22:28:12.621+0200: 16289.664: Total time for which application threads were stopped: 14.1838416 seconds, Stopping threads took: 0.0000498 seconds
2016-10-27T22:28:12.638+0200: 16289.681: Total time for which application threads were stopped: 0.0167055 seconds, Stopping threads took: 0.0002064 seconds
2016-10-27T22:28:12.652+0200: 16289.696: Total time for which application threads were stopped: 0.0140258 seconds, Stopping threads took: 0.0000369 seconds
Here is my dstat result
read writ|run blk new| used buff cach free| in out | read writ| int csw |usr sys idl wai hiq siq| recv send
0 0.50 |1.0 0 0.4|39.4G 47.9M 22.0G 1384M| 0 0 | 0 7782B| 599 3866 | 3 0 97 0 0 0|2102B 1587B
0 0.40 |1.0 0 0.1|39.4G 47.9M 22.0G 1384M| 0 0 | 0 2458B|3448 3917 | 3 0 97 0 0 0|1533B 1212B
0 1.50 |1.1 0 0.3|39.4G 47.9M 22.0G 1387M| 0 0 | 0 8192B| 575 3888 | 3 0 97 0 0 0|1448B 993B
0 0.80 |4.2 0 0|39.4G 47.9M 22.0G 1386M| 0 0 | 0 5325B|5308 4954 | 18 0 82 0 0 0|1631B 1109B
0 0.20 |1.0 0 0.2|39.4G 47.9M 22.0G 1386M| 0 0 | 0 2048B| 792 4099 | 3 0 97 0 0 0|2016B 1670B
0 0.90 |1.0 0 0|39.4G 47.9M 22.0G 1388M| 0 0 | 0 5325B| 988 3838 | 3 0 97 0 0 0|1697B 1150B
0 0.20 |1.0 0 0.4|39.4G 47.9M 22.0G 1389M| 0 0 | 0 1638B| 624 3851 | 3 0 97 0 0 0|1559B 1126B
0 0.60 |1.0 0 0.1|39.4G 47.9M 22.0G 1390M| 0 0 | 0 5734B| 698 3801 | 3 0 97 0 0 0|1654B 1091B
0 0.60 |7.4 0 0|39.4G 47.9M 22.0G 1386M| 0 0 | 0 4506B|5171 5278 | 18 0 82 0 0 0|1512B 1402B
0 0.50 |1.0 0 0|39.4G 47.9M 22.0G 1389M| 0 0 | 0 2048B| 604 3813 | 3 0 97 0 0 0|1669B 1064B
0 0.70 |1.1 0 202|39.4G 47.9M 22.0G 1375M| 0 0 | 0 9011B|2527 5829 | 3 1 96 0 0 0|2682B 6059B
0 0.50 |1.2 0 126|39.4G 47.9M 22.0G 1379M| 0 0 | 0 10k| 870 5047 | 3 0 96 0 0 0|2179B 3525B
0 0.40 |4.1 0 0.3|39.4G 48.0M 22.0G 1380M| 0 0 | 0 2458B|6802 5359 | 18 0 82 0 0 0|1723B 1943B
0 3.00 |1.0 0 0.1|39.4G 48.0M 22.0G 1384M| 0 0 | 0 19k| 594 3874 | 3 0 97 0 0 0|2028B 1434B
0 0.20 |1.0 0 0|39.4G 48.0M 22.0G 1386M| 0 0 | 0 2867B|1622 3889 | 3 0 97 0 0 0|2070B 1449B
0 0.60 |1.0 0.1 0|39.4G 48.0M 22.0G 1387M| 0 0 | 0 4506B| 604 3837 | 3 0 97 0 0 0|2043B 1369B
Related
I have to get the details such as CPU, Memory(RAM), Battery, Startup time, App Size. Im able to get other things except App Size using Appium. Someone please help.
Thanks
Seems like Appium is not capable to perform this for you. However, you can check the memory usage in Android using adb:
$ adb shell dumpsys meminfo com.android.systemui
Which returns something like this:
Applications Memory Usage (in Kilobytes):
Uptime: 433213978 Realtime: 631179899
** MEMINFO in pid 1541 [com.android.systemui] **
Pss Private Private SwapPss Heap Heap Heap
Total Dirty Clean Dirty Size Alloc Free
------ ------ ------ ------ ------ ------ ------
Native Heap 106880 106780 0 73228 196200 182430 13769
Dalvik Heap 35655 35636 0 217 40741 20371 20370
Dalvik Other 3347 3344 0 112
Stack 56 56 0 16
Ashmem 4 0 0 0
Other dev 18 0 16 0
.so mmap 2998 164 352 499
.jar mmap 669 0 248 0
.apk mmap 17904 0 13620 0
.ttf mmap 372 0 180 0
.dex mmap 10041 16 10020 20
.oat mmap 3848 0 84 0
.art mmap 1641 1364 0 123
Other mmap 64 12 24 0
EGL mtrack 106434 106434 0 0
GL mtrack 55564 55564 0 0
Unknown 1952 1948 0 1565
TOTAL 423227 311318 24544 75780 236941 202801 34139
For iOS, my currently limited toolchain doesn't help much. You may have luck using Instruments, for which you can find here a command-line reference, but I haven't tried that: https://help.apple.com/instruments/mac/current/#/devb14ffaa5
I am loosing about 18k every five minutes in the Unknown Field. Any ideas what this could be and how to debug it?
Thanks!
Applications Memory Usage (kB):
Uptime: 444373583 Realtime: 444373583
** MEMINFO in pid 4758 [org.domain.activity] **
Pss Private Private Swapped Heap Heap Heap
Total Dirty Clean Dirty Size Alloc Free
------ ------ ------ ------ ------ ------ ------
Native Heap 0 0 0 0 13492 12878 613
Dalvik Heap 6983 6912 0 0 8932 7183 1749
Dalvik Other 1761 1620 0 0
Stack 192 192 0 0
Ashmem 7 0 0 0
Other dev 192 188 4 0
.so mmap 2996 2284 88 0
.apk mmap 53 0 12 0
.ttf mmap 7 0 0 0
.dex mmap 896 8 544 0
Other mmap 7 4 0 0
Unknown 12018 11992 0 0
TOTAL 25112 23200 648 0 22424 20061 2362
Objects
Views: 26 ViewRootImpl: 1
AppContexts: 3 Activities: 1
Assets: 3 AssetManagers: 3
Local Binders: 7 Proxy Binders: 16
Death Recipients: 0
OpenSSL Sockets: 0
SQL
MEMORY_USED: 0
PAGECACHE_OVERFLOW: 0 MALLOC_SIZE: 0
Asset Allocations
zip:/data/app/org.domain.activity.apk:/assets/DS-DIGIB.TTF: 24K
I have a list of web browsing data that I'm attempting to convert into a sessions.
An example dataset from a user:
time_millis Type Result
07/10/2015 08:31 1 0
07/10/2015 08:41 1 0
07/10/2015 08:48 2 0
07/10/2015 08:50 2 0
07/10/2015 09:11 2 1
07/10/2015 09:14 3 0
07/10/2015 09:15 1 0
07/10/2015 09:17 1 0
07/10/2015 10:31 1 0
07/10/2015 10:33 1 0
07/10/2015 10:36 1 0
07/10/2015 18:57 1 1
I am trying to achieve:
time_millis Type Result Session
07/10/2015 08:31 1 0 1
07/10/2015 08:41 1 0 1
07/10/2015 08:48 2 0 2
07/10/2015 08:50 2 0 2
07/10/2015 09:11 2 1 3
07/10/2015 09:14 3 0 4
07/10/2015 09:15 1 0 4
07/10/2015 09:17 1 0 4
07/10/2015 10:31 1 0 5
07/10/2015 10:33 1 0 5
07/10/2015 10:36 1 0 5
07/10/2015 18:57 1 1 6
I'd like to partition the sessions by a 15 minute window per user and also create a new session if the 'Type' is changed.
I've tried using the following bit of code, though I don't think it performs as I'd like above:
CONDITIONAL_TRUE_EVENT("time_millis" > coalesce(lag("time_millis"), 1)
+ 900000 OR type != LAG(type,1)) OVER (PARTITION BY user ORDER BY
time_millis) AS session_id
You could bucket the time into four 15 minute buckets and compare the current bucket to the last bucket in your event check.
Trunc the time to minutes, subtract the time mod 15 minutes to place it in a 15 minute bucket. Originally I thought just to do the div only on the minute but if you have an hour gap it would break, so you need to include the full timestamp.
TRUNC("time_millis",'MI') - (EXTRACT(MINUTE FROM "time_millis") % 15) * interval '1 minute'
In your formula...
CONDITIONAL_TRUE_EVENT("time_millis" > coalesce(lag("time_millis"), 1) + 900000
OR type != LAG(type,1)
OR TRUNC("time_millis",'MI') - (EXTRACT(MINUTE FROM "time_millis") % 15) * interval '1 minute' != TRUNC(LAG("time_millis",1),'MI') - (EXTRACT(MINUTE FROM LAG("time_millis",1)) % 15) * interval '1 minute')
OVER (PARTITION BY user ORDER BY time_millis) AS session_id
Another idea would be to only change the event if the last event was more than 15 minutes from the current event. It really depends on what you want to do, but I thought this might be useful too. Take the diff, extract the epoch (number of seconds total) divide by 60 to get minutes.
EXTRACT(EPOCH FROM ("time_millis" - LAG("time_millis",1)))/60 > 15
In your formula...
CONDITIONAL_TRUE_EVENT("time_millis" > coalesce(lag("time_millis"), 1) + 900000
OR type != LAG(type,1)
OR EXTRACT(EPOCH FROM ("time_millis" - LAG("time_millis",1)))/60 > 15)
OVER (PARTITION BY user ORDER BY time_millis) AS session_id
date_entry time_start time_finished idle_code qty_good
8/8/2013 13:00 13:30 6 10
8/8/2013 13:30 15:20 0 20
8/8/2013 15:20 15:30 6 5
8/8/2013 15:30 16:25 0 10
8/8/2013 16:25 16:40 7 0
8/8/2013 16:40 17:25 0 40
8/8/2013 17:25 17:40 3 10
8/8/2013 17:40 24:00 1
8/8/2013 24:00 00:00 1
8/8/2013 00:00 00:30 1
Idle Time Legend:
0 Production
1 Adjustment/Mold
2 Machine
3 Quality Matter
4 Supply Matter
5 Mold Change
6 Replacer
7 Others
----------Result--------------------------------------
total mins
idle_code total mins
1 - 410:00 mins
2 - 00:00
3 - 15:00
4 - 00:00
5 - 00:00
6 - 40:00
7 - 15:00
0 - 210:00
First question how to group by idle_code and add the total mins.?
---------other report----------------------------------
production efficientcy report
idle_code total mins
1 410:00 mins
2 00:00 mins
3 15:00 mins
4 00:00 mins
5 00:00 mins
7 15:00 mins
total idle time = 440:00 mins (formula: sum(total mins of idle 1,2,3,4,5,7))
idle rate = 63.77% (formula: (total idle time / total actual production time)* 100 )
total operation time = 250:00 mins (formula sum(idl_code '0' and idle_code '6'))
machine efficienct = 36.23% (formula (total operation time / total actual production time * 100))
total actual production time = 690:00 mins (formula sum(total_idle_time + total operation time))
this is easy to compute in the powerbuilder using computed field but my problem is how to group them by idle_code and there total mins.
You could do this as a single SQL statement, summing the difference between the start and finish times, and grouping on idle_code. (Don't forget to make this a Left Outer Join from the Idle_Code table to the Production data table). This would save you from retrieving all the detail data to the client, and doing the grouping and summing there.
If you need to do this as a computed column, and you've retrieved all the detail data, then create a group on idle_code, and create a computed column that sums (time_finished - time_start for group 1). The SecondsAfter() function can do this, if those columns are datetimes and not just time values.
How are you storing your time_start and time_finished columns? Are those datetime datatypes? Because that makes the calculations much easier. If they're just times, you'll have problems calculating the duration when those times cross midnight into the next day.
I want a list of all timezones in the mysql timezone tables, and need to select:
1) Their current offset from GMT
2) Whether DST is used by that timezone (not whether it's currently in use, just whether DST is considered at some point in the year for that timezone)
Reason:
I need to build a web form and match the users time zone information (which I can generate from javascript) to the correct time zone stored in the mysql DB. I can find UTC offset and get a DST flag from javascript functions.
Try this query. The offsettime is the (Offset / 60 / 60)
SELECT tzname.`Time_zone_id`,(`Offset`/60/60) AS `offsettime`,`Is_DST`,`Name`,`Transition_type_id`,`Abbreviation`
FROM `time_zone_transition_type` AS `transition`, `time_zone_name` AS `tzname`
WHERE transition.`Time_zone_id`=tzname.`Time_zone_id`
ORDER BY transition.`Offset` ASC;
The results are
501 -12.00000000 0 0 PHOT Pacific/Enderbury
369 -12.00000000 0 0 GMT+12 Etc/GMT+12
513 -12.00000000 0 1 KWAT Pacific/Kwajalein
483 -12.00000000 0 1 KWAT Kwajalein
518 -11.50000000 0 1 NUT Pacific/Niue
496 -11.50000000 0 1 SAMT Pacific/Apia
528 -11.50000000 0 1 SAMT Pacific/Samoa
555 -11.50000000 0 1 SAMT US/Samoa
521 -11.50000000 0 1 SAMT Pacific/Pago_Pago
496 -11.44888889 0 0 LMT Pacific/Apia
528 -11.38000000 0 0 LMT Pacific/Samoa
555 -11.38000000 0 0 LMT US/Samoa
521 -11.38000000 0 0 LMT Pacific/Pago_Pago
518 -11.33333333 0 0 NUT Pacific/Niue
544 -11.00000000 0 3 BST US/Aleutian
163 -11.00000000 0 3 BST America/Nome
518 -11.00000000 0 2 NUT Pacific/Niue
496 -11.00000000 0 2 WST Pacific/Apia
544 -11.00000000 0 0 NST US/Aleutian
163 -11.00000000 0 0 NST America/Nome
528 -11.00000000 0 4 SST Pacific/Samoa
528 -11.00000000 0 3 BST Pacific/Samoa