Playing with the 2.0 temperature controller for past few days. Here is my pico tank;'s temperature chart, where the temperature controller is set at with larger threshold than than the heater. As a result, heater's internal thermostat is switching hetar on/off while the equipment is always on from reef-pi side, temperature controller is acting as failsafe only, in case things go south then will switch off heater and send alert.
The nano tank is setup in opposite way. With heater itself configured at bit higher setting (80) and reef-pi configured at 79.5, with 30 seconds interval. I am playing with 79.4. 79.3 after few hours to see the effect. Notice heater/cooler graph is now showing heater usage (as it is being turned on/off by reef-pi itself)
my realizations was pretty exciting. reef-pi switching on/off heater almost half the time when run at 60s interval. I get much finer control but it comes at a cost of switching heater on/off more frequently.
I am thinking of adding support for hysteresis and setpoints. Though this whole scheme work for heater, its not useful for chillers (and do they come without thermostat ?? ). I wanted to share this, as it will be really interesting to see how these graphs look after i implement hysteresis /setpoint based logic
Well I was looking on my phone at the dashboard and it kind of reset my graphs, I went from information like you to this now:
I have not rebooted since its linux and should not have to be rebooted but not sure what is going on, my memory usage was climbing but thats normal for linux since it will use whats available, I will go check the logs and see if I can see what may have happened.
Looked at the logs the only thing I see is this -
ERROR:Failed to get controller temperature. Error: fork/exec /usr/bin/vcgencmd: cannot allocate memory
Updates looks like I found the issue:
Jan 19 16:37:27 tankpi kernel: INFO: task kworker/0:0:1177 blocked for more than 120 seconds.
Jan 19 16:37:27 tankpi kernel: Not tainted 4.14.79-v7+ #1159
Jan 19 16:37:27 tankpi kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 19 16:37:27 tankpi kernel: kworker/0:0 D 0 1177 2 0x00000000
Jan 19 16:37:27 tankpi kernel: Workqueue: events_freezable mmc_rescan
Jan 19 16:37:27 tankpi kernel: [<8079ef70>] (__schedule) from [<8079f5d8>] (schedule+0x50/0xa8)
Jan 19 16:37:27 tankpi kernel: [<8079f5d8>] (schedule) from [<8061a2d0>] (__mmc_claim_host+0xb8/0x1cc)
Jan 19 16:37:27 tankpi kernel: [<8061a2d0>] (__mmc_claim_host) from [<8061a414>] (mmc_get_card+0x30/0x34)
Jan 19 16:37:27 tankpi kernel: [<8061a414>] (mmc_get_card) from [<80623010>] (mmc_sd_detect+0x20/0x74)
Jan 19 16:37:27 tankpi kernel: [<80623010>] (mmc_sd_detect) from [<8061ccdc>] (mmc_rescan+0x1c8/0x394)
Jan 19 16:37:27 tankpi kernel: [<8061ccdc>] (mmc_rescan) from [<801379b4>] (process_one_work+0x158/0x454)
Jan 19 16:37:27 tankpi kernel: [<801379b4>] (process_one_work) from [<80137d14>] (worker_thread+0x64/0x5b8)
Jan 19 16:37:27 tankpi kernel: [<80137d14>] (worker_thread) from [<8013dd98>] (kthread+0x13c/0x16c)
Jan 19 16:37:27 tankpi kernel: [<8013dd98>] (kthread) from [<801080ac>] (ret_from_fork+0x14/0x28)
Jan 19 16:37:27 tankpi kernel: reef-pi invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0
Jan 19 16:37:27 tankpi kernel: reef-pi cpuset=/ mems_allowed=0
Jan 19 16:37:27 tankpi kernel: CPU: 0 PID: 6629 Comm: reef-pi Not tainted 4.14.79-v7+ #1159
Jan 19 16:37:27 tankpi kernel: Hardware name: BCM2835
Jan 19 16:37:27 tankpi kernel: [<8010ff30>] (unwind_backtrace) from [<8010c174>] (show_stack+0x20/0x24)
Jan 19 16:37:27 tankpi kernel: [<8010c174>] (show_stack) from [<80788fa4>] (dump_stack+0xd4/0x118)
Jan 19 16:37:27 tankpi kernel: [<80788fa4>] (dump_stack) from [<802249ec>] (dump_header+0xac/0x208)
Jan 19 16:37:27 tankpi kernel: [<802249ec>] (dump_header) from [<80223d54>] (oom_kill_process+0x478/0x584)
Jan 19 16:37:27 tankpi kernel: [<80223d54>] (oom_kill_process) from [<802246b4>] (out_of_memory+0x124/0x334)
Jan 19 16:37:27 tankpi kernel: [<802246b4>] (out_of_memory) from [<8022a18c>] (__alloc_pages_nodemask+0x1060/0x11d8)
Jan 19 16:37:27 tankpi kernel: [<8022a18c>] (__alloc_pages_nodemask) from [<80220578>] (filemap_fault+0x558/0x694)
Jan 19 16:37:27 tankpi kernel: [<80220578>] (filemap_fault) from [<8033fef4>] (ext4_filemap_fault+0x38/0x4c)
Jan 19 16:37:27 tankpi kernel: [<8033fef4>] (ext4_filemap_fault) from [<80255fb0>] (__do_fault+0x28/0x78)
Jan 19 16:37:27 tankpi kernel: [<80255fb0>] (__do_fault) from [<80259c18>] (handle_mm_fault+0x4d4/0xc20)
Jan 19 16:37:27 tankpi kernel: [<80259c18>] (handle_mm_fault) from [<807a564c>] (do_page_fault+0x330/0x3a4)
Jan 19 16:37:27 tankpi kernel: [<807a564c>] (do_page_fault) from [<801012a0>] (do_PrefetchAbort+0x44/0xa8)
Jan 19 16:37:27 tankpi kernel: [<801012a0>] (do_PrefetchAbort) from [<807a50e4>] (ret_from_exception+0x0/0x1c)
Jan 19 16:37:27 tankpi kernel: Exception stack(0x850cdfb0 to 0x850cdff8)
Jan 19 16:37:27 tankpi kernel: dfa0: 2a1f3b34 00000007 00000040 00000040
Jan 19 16:37:27 tankpi kernel: dfc0: 00000007 00000036 00000007 2aa4d93c 2a1f3b36 00000009 11665ce0 2aa4d93e
Jan 19 16:37:27 tankpi kernel: dfe0: 00000038 2aa4d9b0 000782c4 0029b684 60000010 ffffffff
Jan 19 16:37:27 tankpi kernel: Mem-Info:
Jan 19 16:37:27 tankpi kernel: active_anon:49467 inactive_anon:49491 isolated_anon:0
active_file:318 inactive_file:303 isolated_file:32
unevictable:0 dirty:0 writeback:15 unstable:0
slab_reclaimable:1473 slab_unreclaimable:2416
mapped:410 shmem:204 pagetables:389 bounce:0
free:4068 free_pcp:163 free_cma:116
Jan 19 16:37:27 tankpi kernel: Node 0 active_anon:197868kB inactive_anon:197964kB active_file:1272kB inactive_file:1212kB unevictable:0kB isolated(anon):0kB isolated(file):128kB mapped:1640kB dirt
Jan 19 16:37:27 tankpi kernel: Normal free:16272kB min:16384kB low:20480kB high:24576kB active_anon:197884kB inactive_anon:197964kB active_file:1088kB inactive_file:1636kB unevictable:0kB writepen
Jan 19 16:37:27 tankpi kernel: lowmem_reserve[]: 0 0
Jan 19 16:37:27 tankpi kernel: Normal: 273*4kB (UMEHC) 253*8kB (UMEHC) 86*16kB (UMEHC) 24*32kB (MEH) 17*64kB (MEH) 8*128kB (UMEH) 7*256kB (UMEH) 2*512kB (U) 0*1024kB 3*2048kB (UME) 0*4096kB = 1633
Jan 19 16:37:27 tankpi kernel: 897 total pagecache pages
Jan 19 16:37:27 tankpi kernel: 6 pages in swap cache
Jan 19 16:37:27 tankpi kernel: Swap cache stats: add 92893, delete 92887, find 36218/71415
Jan 19 16:37:27 tankpi kernel: Free swap = 0kB
Jan 19 16:37:27 tankpi kernel: Total swap = 102396kB
Jan 19 16:37:27 tankpi kernel: 114688 pages RAM
Jan 19 16:37:27 tankpi kernel: 0 pages HighMem/MovableOnly
Jan 19 16:37:27 tankpi kernel: 4103 pages reserved
Jan 19 16:37:27 tankpi kernel: 2048 pages cma reserved
Jan 19 16:37:27 tankpi kernel: [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
Jan 19 16:37:27 tankpi kernel: [ 99] 0 99 7195 99 13 0 74 0 systemd-journal
Jan 19 16:37:27 tankpi kernel: [ 124] 0 124 3585 15 7 0 151 -1000 systemd-udevd
Jan 19 16:37:27 tankpi kernel: [ 241] 100 241 4320 15 10 0 96 0 systemd-timesyn
Jan 19 16:37:27 tankpi kernel: [ 280] 0 280 5937 70 10 0 207 0 rsyslogd
Jan 19 16:37:27 tankpi kernel: [ 282] 65534 282 1324 4 7 0 56 0 thd
Jan 19 16:37:27 tankpi kernel: [ 284] 0 284 1324 15 7 0 41 0 cron
Jan 19 16:37:27 tankpi kernel: [ 287] 108 287 1640 56 7 0 69 0 avahi-daemon
Jan 19 16:37:27 tankpi kernel: [ 288] 0 288 1853 20 7 0 84 0 systemd-logind
Jan 19 16:37:27 tankpi kernel: [ 292] 105 292 1623 2 7 0 105 -900 dbus-daemon
Jan 19 16:37:27 tankpi kernel: [ 296] 108 296 1601 0 7 0 77 0 avahi-daemon
Jan 19 16:37:27 tankpi kernel: [ 428] 0 428 2534 32 9 0 107 0 wpa_supplicant
Jan 19 16:37:27 tankpi kernel: [ 460] 0 460 524 0 4 0 34 0 hciattach
Jan 19 16:37:27 tankpi kernel: [ 466] 0 466 1769 0 7 0 76 0 bluetoothd
Jan 19 16:37:27 tankpi kernel: [ 524] 0 524 721 28 7 0 56 0 dhcpcd
Jan 19 16:37:27 tankpi kernel: [ 536] 0 536 1049 0 6 0 35 0 agetty
Jan 19 16:37:27 tankpi kernel: [ 540] 0 540 2553 0 9 0 138 -1000 sshd
Jan 19 16:37:27 tankpi kernel: [ 5969] 0 5969 201711 98153 240 0 18660 0 reef-pi
Jan 19 16:37:27 tankpi kernel: [ 1678] 0 1678 475 38 5 0 0 0 dhcpcd-run-hook
Jan 19 16:37:27 tankpi kernel: [ 1681] 0 1681 475 31 5 0 0 0 resolvconf
Jan 19 16:37:27 tankpi kernel: [ 1682] 0 1682 673 24 5 0 0 0 mkdir
Jan 19 16:37:27 tankpi kernel: Out of memory: Kill process 5969 (reef-pi) score 833 or sacrifice child
Jan 19 16:37:27 tankpi kernel: Killed process 5969 (reef-pi) total-vm:806844kB, anon-rss:392612kB, file-rss:0kB, shmem-rss:0kB
Jan 19 16:37:27 tankpi kernel: oom_reaper: reaped process 5969 (reef-pi), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Jan 19 16:37:27 tankpi reef-pi[5969]: 2019/01/19 16:34:57 temperature sub-system: sensor Temp3-2.5g value: 77.9
Jan 19 16:35:23 tankpi dhcpcd[524]: wlan0: fe80::21f:29ff:fe5a:17aa: router expired
Jan 19 16:35:24 tankpi dhcpcd[524]: wlan0: deleting default route via fe80::21f:29ff:fe5a:17aa
Jan 19 16:37:27 tankpi systemd[1]: reef-pi.service: Main process exited, code=killed, status=9/KILL
Jan 19 16:37:27 tankpi systemd[1]: reef-pi.service: Unit entered failed state.
Jan 19 16:37:27 tankpi systemd[1]: reef-pi.service: Failed with result 'signal'.
Jan 19 16:37:27 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:27 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:27 tankpi dhcpcd[524]: wlan0: adding default route via fe80::21f:29ff:fe5a:17aa
Jan 19 16:37:28 tankpi systemd[1]: Starting Daily apt download activities...
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:31 tankpi systemd[1]: Started Daily apt download activities.
Jan 19 16:37:31 tankpi systemd[1]: apt-daily.timer: Adding 1h 32min 6.685914s random time.
Jan 19 16:37:31 tankpi systemd[1]: apt-daily.timer: Adding 6h 34min 57.228675s random time.
Jan 19 16:37:37 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:37 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:53 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:53 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:04 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:04 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:22 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:22 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:27 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:27 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:34 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:34 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:46 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:46 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:58 tankpi systemd[1]: reef-pi.service: Service hold-off time over, scheduling restart.
Jan 19 16:38:58 tankpi systemd[1]: Stopped raspberry pi based reef tank controller.
Jan 19 16:38:58 tankpi systemd[1]: Started raspberry pi based reef tank controller.
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: macro
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: system
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 27 State: 1
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 22 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 23 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 24 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 25 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 5 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 6 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 12 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 INFO: equipment subsystem: Finished syncing all equipment
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: equipment
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully added cron entry. ID: 1
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully added cron entry. ID: 2
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: timers
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: ato
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 ERROR: temperature subsystem. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 ERROR: temperature subsystem. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 ERROR: temperature subsystem. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:38:59 tankpi reef-pi[2023]: 2019/01/19 16:38:59 ERROR: health checker. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:39:00 tankpi reef-pi[2023]: 2019/01/19 16:39:00 ERROR: stats for id: '1' not found
Jan 19 16:39:00 tankpi reef-pi[2023]: 2019/01/19 16:39:00 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:01 tankpi reef-pi[2023]: 2019/01/19 16:39:01 ERROR: stats for id: '1' not found
Jan 19 16:39:01 tankpi reef-pi[2023]: 2019/01/19 16:39:01 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:03 tankpi reef-pi[2023]: 2019/01/19 16:39:03 ERROR: stats for id: '2' not found
Jan 19 16:39:03 tankpi reef-pi[2023]: 2019/01/19 16:39:03 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:04 tankpi reef-pi[2023]: 2019/01/19 16:39:04 ERROR: stats for id: '2' not found
Jan 19 16:39:04 tankpi reef-pi[2023]: 2019/01/19 16:39:04 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:06 tankpi reef-pi[2023]: 2019/01/19 16:39:06 ERROR: stats for id: '3' not found
Jan 19 16:39:06 tankpi reef-pi[2023]: 2019/01/19 16:39:06 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:07 tankpi reef-pi[2023]: 2019/01/19 16:39:07 ERROR: stats for id: '3' not found
Jan 19 16:39:07 tankpi reef-pi[2023]: 2019/01/19 16:39:07 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:10 tankpi reef-pi[2023]: 2019/01/19 16:39:10 ERROR: stats for id: '1' not found
Jan 19 16:39:10 tankpi reef-pi[2023]: 2019/01/19 16:39:10 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:11 tankpi reef-pi[2023]: 2019/01/19 16:39:11 ERROR: stats for id: '1' not found
Jan 19 16:39:11 tankpi reef-pi[2023]: 2019/01/19 16:39:11 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:13 tankpi reef-pi[2023]: 2019/01/19 16:39:13 ERROR: stats for id: '2' not found
Jan 19 16:39:13 tankpi reef-pi[2023]: 2019/01/19 16:39:13 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:15 tankpi reef-pi[2023]: 2019/01/19 16:39:15 ERROR: stats for id: '2' not found
Jan 19 16:39:15 tankpi reef-pi[2023]: 2019/01/19 16:39:15 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:16 tankpi reef-pi[2023]: 2019/01/19 16:39:16 ERROR: stats for id: '3' not found
Jan 19 16:39:16 tankpi reef-pi[2023]: 2019/01/19 16:39:16 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:17 tankpi reef-pi[2023]: 2019/01/19 16:39:17 ERROR: stats for id: '3' not found
Jan 19 16:39:17 tankpi reef-pi[2023]: 2019/01/19 16:39:17 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:20 tankpi reef-pi[2023]: 2019/01/19 16:39:20 ERROR: stats for id: '1' not found
Jan 19 16:39:20 tankpi reef-pi[2023]: 2019/01/19 16:39:20 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:21 tankpi reef-pi[2023]: 2019/01/19 16:39:21 ERROR: stats for id: '1' not found
Jan 19 16:39:21 tankpi reef-pi[2023]: 2019/01/19 16:39:21 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:23 tankpi reef-pi[2023]: 2019/01/19 16:39:23 ERROR: stats for id: '2' not found
Jan 19 16:39:23 tankpi reef-pi[2023]: 2019/01/19 16:39:23 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:24 tankpi reef-pi[2023]: 2019/01/19 16:39:24 ERROR: stats for id: '2' not found
Jan 19 16:39:24 tankpi reef-pi[2023]: 2019/01/19 16:39:24 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:26 tankpi reef-pi[2023]: 2019/01/19 16:39:26 ERROR: stats for id: '3' not found
Jan 19 16:39:26 tankpi reef-pi[2023]: 2019/01/19 16:39:26 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:27 tankpi reef-pi[2023]: 2019/01/19 16:39:27 ERROR: stats for id: '3' not found
Jan 19 16:39:27 tankpi reef-pi[2023]: 2019/01/19 16:39:27 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:30 tankpi reef-pi[2023]: 2019/01/19 16:39:30 ERROR: stats for id: '1' not found
Jan 19 16:39:30 tankpi reef-pi[2023]: 2019/01/19 16:39:30 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:31 tankpi reef-pi[2023]: 2019/01/19 16:39:31 ERROR: stats for id: '1' not found
Jan 19 16:39:31 tankpi reef-pi[2023]: 2019/01/19 16:39:31 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:33 tankpi reef-pi[2023]: 2019/01/19 16:39:33 ERROR: stats for id: '2' not found
Jan 19 16:39:33 tankpi reef-pi[2023]: 2019/01/19 16:39:33 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:35 tankpi reef-pi[2023]: 2019/01/19 16:39:35 ERROR: stats for id: '2' not found
Jan 19 16:39:35 tankpi reef-pi[2023]: 2019/01/19 16:39:35 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:36 tankpi reef-pi[2023]: 2019/01/19 16:39:36 ERROR: stats for id: '3' not found
Jan 19 16:39:36 tankpi reef-pi[2023]: 2019/01/19 16:39:36 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:37 tankpi reef-pi[2023]: 2019/01/19 16:39:37 ERROR: stats for id: '3' not found
Jan 19 16:39:37 tankpi reef-pi[2023]: 2019/01/19 16:39:37 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:40 tankpi reef-pi[2023]: 2019/01/19 16:39:40 ERROR: stats for id: '1' not found
Jan 19 16:39:40 tankpi reef-pi[2023]: 2019/01/19 16:39:40 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:41 tankpi reef-pi[2023]: 2019/01/19 16:39:41 ERROR: stats for id: '1' not found
Jan 19 16:39:41 tankpi reef-pi[2023]: 2019/01/19 16:39:41 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:44 tankpi reef-pi[2023]: 2019/01/19 16:39:44 ERROR: stats for id: '2' not found
Jan 19 16:39:44 tankpi reef-pi[2023]: 2019/01/19 16:39:44 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:45 tankpi reef-pi[2023]: 2019/01/19 16:39:45 ERROR: stats for id: '2' not found
Jan 19 16:39:45 tankpi reef-pi[2023]: 2019/01/19 16:39:45 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:46 tankpi reef-pi[2023]: 2019/01/19 16:39:46 ERROR: stats for id: '3' not found
Jan 19 16:39:46 tankpi reef-pi[2023]: 2019/01/19 16:39:46 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:47 tankpi reef-pi[2023]: 2019/01/19 16:39:47 ERROR: stats for id: '3' not found
Jan 19 16:39:47 tankpi reef-pi[2023]: 2019/01/19 16:39:47 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:50 tankpi reef-pi[2023]: 2019/01/19 16:39:50 ERROR: stats for id: '1' not found
Jan 19 16:39:50 tankpi reef-pi[2023]: 2019/01/19 16:39:50 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:51 tankpi reef-pi[2023]: 2019/01/19 16:39:51 ERROR: stats for id: '1' not found
Jan 19 16:39:51 tankpi reef-pi[2023]: 2019/01/19 16:39:51 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:53 tankpi reef-pi[2023]: 2019/01/19 16:39:53 ERROR: stats for id: '2' not found
Jan 19 16:39:53 tankpi reef-pi[2023]: 2019/01/19 16:39:53 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:55 tankpi reef-pi[2023]: 2019/01/19 16:39:55 ERROR: stats for id: '2' not found
Jan 19 16:39:55 tankpi reef-pi[2023]: 2019/01/19 16:39:55 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:56 tankpi reef-pi[2023]: 2019/01/19 16:39:56 ERROR: stats for id: '3' not found
Jan 19 16:39:56 tankpi reef-pi[2023]: 2019/01/19 16:39:56 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:58 tankpi reef-pi[2023]: 2019/01/19 16:39:58 ERROR: stats for id: '3' not found
Jan 19 16:39:58 tankpi reef-pi[2023]: 2019/01/19 16:39:58 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:55:57 tankpi reef-pi[2023]: 2019/01/19 16:55:57 ERROR: Failed to reload reef-pi. Output:. Error: signal: terminated
Jan 19 16:55:57 tankpi reef-pi[2023]: 2019/01/19 16:55:57 ERROR: GET /api/admin/reload Failed to reload reef-pi. Output:. Error: signal: terminated
Looks memory related as it ran out of memory, do I need to increase swap? Running on a raspberry pi 3 A+, looks very similar to ryan115 issue, I am running the stable image but have not updated to the latest fixes.Jan 19 16:37:27 tankpi kernel: Not tainted 4.14.79-v7+ #1159
Jan 19 16:37:27 tankpi kernel: "echo 0 > /proc/sys/kernel/hung_task_timeout_secs" disables this message.
Jan 19 16:37:27 tankpi kernel: kworker/0:0 D 0 1177 2 0x00000000
Jan 19 16:37:27 tankpi kernel: Workqueue: events_freezable mmc_rescan
Jan 19 16:37:27 tankpi kernel: [<8079ef70>] (__schedule) from [<8079f5d8>] (schedule+0x50/0xa8)
Jan 19 16:37:27 tankpi kernel: [<8079f5d8>] (schedule) from [<8061a2d0>] (__mmc_claim_host+0xb8/0x1cc)
Jan 19 16:37:27 tankpi kernel: [<8061a2d0>] (__mmc_claim_host) from [<8061a414>] (mmc_get_card+0x30/0x34)
Jan 19 16:37:27 tankpi kernel: [<8061a414>] (mmc_get_card) from [<80623010>] (mmc_sd_detect+0x20/0x74)
Jan 19 16:37:27 tankpi kernel: [<80623010>] (mmc_sd_detect) from [<8061ccdc>] (mmc_rescan+0x1c8/0x394)
Jan 19 16:37:27 tankpi kernel: [<8061ccdc>] (mmc_rescan) from [<801379b4>] (process_one_work+0x158/0x454)
Jan 19 16:37:27 tankpi kernel: [<801379b4>] (process_one_work) from [<80137d14>] (worker_thread+0x64/0x5b8)
Jan 19 16:37:27 tankpi kernel: [<80137d14>] (worker_thread) from [<8013dd98>] (kthread+0x13c/0x16c)
Jan 19 16:37:27 tankpi kernel: [<8013dd98>] (kthread) from [<801080ac>] (ret_from_fork+0x14/0x28)
Jan 19 16:37:27 tankpi kernel: reef-pi invoked oom-killer: gfp_mask=0x14201ca(GFP_HIGHUSER_MOVABLE|__GFP_COLD), nodemask=(null), order=0, oom_score_adj=0
Jan 19 16:37:27 tankpi kernel: reef-pi cpuset=/ mems_allowed=0
Jan 19 16:37:27 tankpi kernel: CPU: 0 PID: 6629 Comm: reef-pi Not tainted 4.14.79-v7+ #1159
Jan 19 16:37:27 tankpi kernel: Hardware name: BCM2835
Jan 19 16:37:27 tankpi kernel: [<8010ff30>] (unwind_backtrace) from [<8010c174>] (show_stack+0x20/0x24)
Jan 19 16:37:27 tankpi kernel: [<8010c174>] (show_stack) from [<80788fa4>] (dump_stack+0xd4/0x118)
Jan 19 16:37:27 tankpi kernel: [<80788fa4>] (dump_stack) from [<802249ec>] (dump_header+0xac/0x208)
Jan 19 16:37:27 tankpi kernel: [<802249ec>] (dump_header) from [<80223d54>] (oom_kill_process+0x478/0x584)
Jan 19 16:37:27 tankpi kernel: [<80223d54>] (oom_kill_process) from [<802246b4>] (out_of_memory+0x124/0x334)
Jan 19 16:37:27 tankpi kernel: [<802246b4>] (out_of_memory) from [<8022a18c>] (__alloc_pages_nodemask+0x1060/0x11d8)
Jan 19 16:37:27 tankpi kernel: [<8022a18c>] (__alloc_pages_nodemask) from [<80220578>] (filemap_fault+0x558/0x694)
Jan 19 16:37:27 tankpi kernel: [<80220578>] (filemap_fault) from [<8033fef4>] (ext4_filemap_fault+0x38/0x4c)
Jan 19 16:37:27 tankpi kernel: [<8033fef4>] (ext4_filemap_fault) from [<80255fb0>] (__do_fault+0x28/0x78)
Jan 19 16:37:27 tankpi kernel: [<80255fb0>] (__do_fault) from [<80259c18>] (handle_mm_fault+0x4d4/0xc20)
Jan 19 16:37:27 tankpi kernel: [<80259c18>] (handle_mm_fault) from [<807a564c>] (do_page_fault+0x330/0x3a4)
Jan 19 16:37:27 tankpi kernel: [<807a564c>] (do_page_fault) from [<801012a0>] (do_PrefetchAbort+0x44/0xa8)
Jan 19 16:37:27 tankpi kernel: [<801012a0>] (do_PrefetchAbort) from [<807a50e4>] (ret_from_exception+0x0/0x1c)
Jan 19 16:37:27 tankpi kernel: Exception stack(0x850cdfb0 to 0x850cdff8)
Jan 19 16:37:27 tankpi kernel: dfa0: 2a1f3b34 00000007 00000040 00000040
Jan 19 16:37:27 tankpi kernel: dfc0: 00000007 00000036 00000007 2aa4d93c 2a1f3b36 00000009 11665ce0 2aa4d93e
Jan 19 16:37:27 tankpi kernel: dfe0: 00000038 2aa4d9b0 000782c4 0029b684 60000010 ffffffff
Jan 19 16:37:27 tankpi kernel: Mem-Info:
Jan 19 16:37:27 tankpi kernel: active_anon:49467 inactive_anon:49491 isolated_anon:0
active_file:318 inactive_file:303 isolated_file:32
unevictable:0 dirty:0 writeback:15 unstable:0
slab_reclaimable:1473 slab_unreclaimable:2416
mapped:410 shmem:204 pagetables:389 bounce:0
free:4068 free_pcp:163 free_cma:116
Jan 19 16:37:27 tankpi kernel: Node 0 active_anon:197868kB inactive_anon:197964kB active_file:1272kB inactive_file:1212kB unevictable:0kB isolated(anon):0kB isolated(file):128kB mapped:1640kB dirt
Jan 19 16:37:27 tankpi kernel: Normal free:16272kB min:16384kB low:20480kB high:24576kB active_anon:197884kB inactive_anon:197964kB active_file:1088kB inactive_file:1636kB unevictable:0kB writepen
Jan 19 16:37:27 tankpi kernel: lowmem_reserve[]: 0 0
Jan 19 16:37:27 tankpi kernel: Normal: 273*4kB (UMEHC) 253*8kB (UMEHC) 86*16kB (UMEHC) 24*32kB (MEH) 17*64kB (MEH) 8*128kB (UMEH) 7*256kB (UMEH) 2*512kB (U) 0*1024kB 3*2048kB (UME) 0*4096kB = 1633
Jan 19 16:37:27 tankpi kernel: 897 total pagecache pages
Jan 19 16:37:27 tankpi kernel: 6 pages in swap cache
Jan 19 16:37:27 tankpi kernel: Swap cache stats: add 92893, delete 92887, find 36218/71415
Jan 19 16:37:27 tankpi kernel: Free swap = 0kB
Jan 19 16:37:27 tankpi kernel: Total swap = 102396kB
Jan 19 16:37:27 tankpi kernel: 114688 pages RAM
Jan 19 16:37:27 tankpi kernel: 0 pages HighMem/MovableOnly
Jan 19 16:37:27 tankpi kernel: 4103 pages reserved
Jan 19 16:37:27 tankpi kernel: 2048 pages cma reserved
Jan 19 16:37:27 tankpi kernel: [ pid ] uid tgid total_vm rss nr_ptes nr_pmds swapents oom_score_adj name
Jan 19 16:37:27 tankpi kernel: [ 99] 0 99 7195 99 13 0 74 0 systemd-journal
Jan 19 16:37:27 tankpi kernel: [ 124] 0 124 3585 15 7 0 151 -1000 systemd-udevd
Jan 19 16:37:27 tankpi kernel: [ 241] 100 241 4320 15 10 0 96 0 systemd-timesyn
Jan 19 16:37:27 tankpi kernel: [ 280] 0 280 5937 70 10 0 207 0 rsyslogd
Jan 19 16:37:27 tankpi kernel: [ 282] 65534 282 1324 4 7 0 56 0 thd
Jan 19 16:37:27 tankpi kernel: [ 284] 0 284 1324 15 7 0 41 0 cron
Jan 19 16:37:27 tankpi kernel: [ 287] 108 287 1640 56 7 0 69 0 avahi-daemon
Jan 19 16:37:27 tankpi kernel: [ 288] 0 288 1853 20 7 0 84 0 systemd-logind
Jan 19 16:37:27 tankpi kernel: [ 292] 105 292 1623 2 7 0 105 -900 dbus-daemon
Jan 19 16:37:27 tankpi kernel: [ 296] 108 296 1601 0 7 0 77 0 avahi-daemon
Jan 19 16:37:27 tankpi kernel: [ 428] 0 428 2534 32 9 0 107 0 wpa_supplicant
Jan 19 16:37:27 tankpi kernel: [ 460] 0 460 524 0 4 0 34 0 hciattach
Jan 19 16:37:27 tankpi kernel: [ 466] 0 466 1769 0 7 0 76 0 bluetoothd
Jan 19 16:37:27 tankpi kernel: [ 524] 0 524 721 28 7 0 56 0 dhcpcd
Jan 19 16:37:27 tankpi kernel: [ 536] 0 536 1049 0 6 0 35 0 agetty
Jan 19 16:37:27 tankpi kernel: [ 540] 0 540 2553 0 9 0 138 -1000 sshd
Jan 19 16:37:27 tankpi kernel: [ 5969] 0 5969 201711 98153 240 0 18660 0 reef-pi
Jan 19 16:37:27 tankpi kernel: [ 1678] 0 1678 475 38 5 0 0 0 dhcpcd-run-hook
Jan 19 16:37:27 tankpi kernel: [ 1681] 0 1681 475 31 5 0 0 0 resolvconf
Jan 19 16:37:27 tankpi kernel: [ 1682] 0 1682 673 24 5 0 0 0 mkdir
Jan 19 16:37:27 tankpi kernel: Out of memory: Kill process 5969 (reef-pi) score 833 or sacrifice child
Jan 19 16:37:27 tankpi kernel: Killed process 5969 (reef-pi) total-vm:806844kB, anon-rss:392612kB, file-rss:0kB, shmem-rss:0kB
Jan 19 16:37:27 tankpi kernel: oom_reaper: reaped process 5969 (reef-pi), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Jan 19 16:37:27 tankpi reef-pi[5969]: 2019/01/19 16:34:57 temperature sub-system: sensor Temp3-2.5g value: 77.9
Jan 19 16:35:23 tankpi dhcpcd[524]: wlan0: fe80::21f:29ff:fe5a:17aa: router expired
Jan 19 16:35:24 tankpi dhcpcd[524]: wlan0: deleting default route via fe80::21f:29ff:fe5a:17aa
Jan 19 16:37:27 tankpi systemd[1]: reef-pi.service: Main process exited, code=killed, status=9/KILL
Jan 19 16:37:27 tankpi systemd[1]: reef-pi.service: Unit entered failed state.
Jan 19 16:37:27 tankpi systemd[1]: reef-pi.service: Failed with result 'signal'.
Jan 19 16:37:27 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:27 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:27 tankpi dhcpcd[524]: wlan0: adding default route via fe80::21f:29ff:fe5a:17aa
Jan 19 16:37:28 tankpi systemd[1]: Starting Daily apt download activities...
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:28 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:28 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:31 tankpi systemd[1]: Started Daily apt download activities.
Jan 19 16:37:31 tankpi systemd[1]: apt-daily.timer: Adding 1h 32min 6.685914s random time.
Jan 19 16:37:31 tankpi systemd[1]: apt-daily.timer: Adding 6h 34min 57.228675s random time.
Jan 19 16:37:37 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:37 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:37:53 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:37:53 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:04 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:04 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:22 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:22 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:27 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:27 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:34 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:34 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:46 tankpi dhcpcd[524]: wlan0: adding address 2001:470:7c:4ef:3f5f:fb0d:5a08:4bc7/66
Jan 19 16:38:46 tankpi dhcpcd[524]: if_addaddress6: Invalid argument
Jan 19 16:38:58 tankpi systemd[1]: reef-pi.service: Service hold-off time over, scheduling restart.
Jan 19 16:38:58 tankpi systemd[1]: Stopped raspberry pi based reef tank controller.
Jan 19 16:38:58 tankpi systemd[1]: Started raspberry pi based reef tank controller.
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: macro
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: system
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 27 State: 1
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 22 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 23 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 24 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 25 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 5 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 6 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Setting GPIO Pin: 12 State: 0
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 INFO: equipment subsystem: Finished syncing all equipment
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: equipment
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully added cron entry. ID: 1
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully added cron entry. ID: 2
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: timers
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 Successfully started subsystem: ato
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 ERROR: temperature subsystem. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 ERROR: temperature subsystem. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:38:58 tankpi reef-pi[2023]: 2019/01/19 16:38:58 ERROR: temperature subsystem. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:38:59 tankpi reef-pi[2023]: 2019/01/19 16:38:59 ERROR: health checker. Failed to load usage. Error: json: cannot unmarshal object into Go struct field StatsOnDisk.current of type []json.RawMessage
Jan 19 16:39:00 tankpi reef-pi[2023]: 2019/01/19 16:39:00 ERROR: stats for id: '1' not found
Jan 19 16:39:00 tankpi reef-pi[2023]: 2019/01/19 16:39:00 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:01 tankpi reef-pi[2023]: 2019/01/19 16:39:01 ERROR: stats for id: '1' not found
Jan 19 16:39:01 tankpi reef-pi[2023]: 2019/01/19 16:39:01 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:03 tankpi reef-pi[2023]: 2019/01/19 16:39:03 ERROR: stats for id: '2' not found
Jan 19 16:39:03 tankpi reef-pi[2023]: 2019/01/19 16:39:03 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:04 tankpi reef-pi[2023]: 2019/01/19 16:39:04 ERROR: stats for id: '2' not found
Jan 19 16:39:04 tankpi reef-pi[2023]: 2019/01/19 16:39:04 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:06 tankpi reef-pi[2023]: 2019/01/19 16:39:06 ERROR: stats for id: '3' not found
Jan 19 16:39:06 tankpi reef-pi[2023]: 2019/01/19 16:39:06 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:07 tankpi reef-pi[2023]: 2019/01/19 16:39:07 ERROR: stats for id: '3' not found
Jan 19 16:39:07 tankpi reef-pi[2023]: 2019/01/19 16:39:07 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:10 tankpi reef-pi[2023]: 2019/01/19 16:39:10 ERROR: stats for id: '1' not found
Jan 19 16:39:10 tankpi reef-pi[2023]: 2019/01/19 16:39:10 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:11 tankpi reef-pi[2023]: 2019/01/19 16:39:11 ERROR: stats for id: '1' not found
Jan 19 16:39:11 tankpi reef-pi[2023]: 2019/01/19 16:39:11 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:13 tankpi reef-pi[2023]: 2019/01/19 16:39:13 ERROR: stats for id: '2' not found
Jan 19 16:39:13 tankpi reef-pi[2023]: 2019/01/19 16:39:13 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:15 tankpi reef-pi[2023]: 2019/01/19 16:39:15 ERROR: stats for id: '2' not found
Jan 19 16:39:15 tankpi reef-pi[2023]: 2019/01/19 16:39:15 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:16 tankpi reef-pi[2023]: 2019/01/19 16:39:16 ERROR: stats for id: '3' not found
Jan 19 16:39:16 tankpi reef-pi[2023]: 2019/01/19 16:39:16 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:17 tankpi reef-pi[2023]: 2019/01/19 16:39:17 ERROR: stats for id: '3' not found
Jan 19 16:39:17 tankpi reef-pi[2023]: 2019/01/19 16:39:17 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:20 tankpi reef-pi[2023]: 2019/01/19 16:39:20 ERROR: stats for id: '1' not found
Jan 19 16:39:20 tankpi reef-pi[2023]: 2019/01/19 16:39:20 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:21 tankpi reef-pi[2023]: 2019/01/19 16:39:21 ERROR: stats for id: '1' not found
Jan 19 16:39:21 tankpi reef-pi[2023]: 2019/01/19 16:39:21 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:23 tankpi reef-pi[2023]: 2019/01/19 16:39:23 ERROR: stats for id: '2' not found
Jan 19 16:39:23 tankpi reef-pi[2023]: 2019/01/19 16:39:23 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:24 tankpi reef-pi[2023]: 2019/01/19 16:39:24 ERROR: stats for id: '2' not found
Jan 19 16:39:24 tankpi reef-pi[2023]: 2019/01/19 16:39:24 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:26 tankpi reef-pi[2023]: 2019/01/19 16:39:26 ERROR: stats for id: '3' not found
Jan 19 16:39:26 tankpi reef-pi[2023]: 2019/01/19 16:39:26 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:27 tankpi reef-pi[2023]: 2019/01/19 16:39:27 ERROR: stats for id: '3' not found
Jan 19 16:39:27 tankpi reef-pi[2023]: 2019/01/19 16:39:27 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:30 tankpi reef-pi[2023]: 2019/01/19 16:39:30 ERROR: stats for id: '1' not found
Jan 19 16:39:30 tankpi reef-pi[2023]: 2019/01/19 16:39:30 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:31 tankpi reef-pi[2023]: 2019/01/19 16:39:31 ERROR: stats for id: '1' not found
Jan 19 16:39:31 tankpi reef-pi[2023]: 2019/01/19 16:39:31 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:33 tankpi reef-pi[2023]: 2019/01/19 16:39:33 ERROR: stats for id: '2' not found
Jan 19 16:39:33 tankpi reef-pi[2023]: 2019/01/19 16:39:33 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:35 tankpi reef-pi[2023]: 2019/01/19 16:39:35 ERROR: stats for id: '2' not found
Jan 19 16:39:35 tankpi reef-pi[2023]: 2019/01/19 16:39:35 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:36 tankpi reef-pi[2023]: 2019/01/19 16:39:36 ERROR: stats for id: '3' not found
Jan 19 16:39:36 tankpi reef-pi[2023]: 2019/01/19 16:39:36 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:37 tankpi reef-pi[2023]: 2019/01/19 16:39:37 ERROR: stats for id: '3' not found
Jan 19 16:39:37 tankpi reef-pi[2023]: 2019/01/19 16:39:37 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:40 tankpi reef-pi[2023]: 2019/01/19 16:39:40 ERROR: stats for id: '1' not found
Jan 19 16:39:40 tankpi reef-pi[2023]: 2019/01/19 16:39:40 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:41 tankpi reef-pi[2023]: 2019/01/19 16:39:41 ERROR: stats for id: '1' not found
Jan 19 16:39:41 tankpi reef-pi[2023]: 2019/01/19 16:39:41 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:44 tankpi reef-pi[2023]: 2019/01/19 16:39:44 ERROR: stats for id: '2' not found
Jan 19 16:39:44 tankpi reef-pi[2023]: 2019/01/19 16:39:44 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:45 tankpi reef-pi[2023]: 2019/01/19 16:39:45 ERROR: stats for id: '2' not found
Jan 19 16:39:45 tankpi reef-pi[2023]: 2019/01/19 16:39:45 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:46 tankpi reef-pi[2023]: 2019/01/19 16:39:46 ERROR: stats for id: '3' not found
Jan 19 16:39:46 tankpi reef-pi[2023]: 2019/01/19 16:39:46 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:47 tankpi reef-pi[2023]: 2019/01/19 16:39:47 ERROR: stats for id: '3' not found
Jan 19 16:39:47 tankpi reef-pi[2023]: 2019/01/19 16:39:47 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:50 tankpi reef-pi[2023]: 2019/01/19 16:39:50 ERROR: stats for id: '1' not found
Jan 19 16:39:50 tankpi reef-pi[2023]: 2019/01/19 16:39:50 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:51 tankpi reef-pi[2023]: 2019/01/19 16:39:51 ERROR: stats for id: '1' not found
Jan 19 16:39:51 tankpi reef-pi[2023]: 2019/01/19 16:39:51 ERROR: GET /api/tcs/1/usage stats for id: '1' not found
Jan 19 16:39:53 tankpi reef-pi[2023]: 2019/01/19 16:39:53 ERROR: stats for id: '2' not found
Jan 19 16:39:53 tankpi reef-pi[2023]: 2019/01/19 16:39:53 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:55 tankpi reef-pi[2023]: 2019/01/19 16:39:55 ERROR: stats for id: '2' not found
Jan 19 16:39:55 tankpi reef-pi[2023]: 2019/01/19 16:39:55 ERROR: GET /api/tcs/2/usage stats for id: '2' not found
Jan 19 16:39:56 tankpi reef-pi[2023]: 2019/01/19 16:39:56 ERROR: stats for id: '3' not found
Jan 19 16:39:56 tankpi reef-pi[2023]: 2019/01/19 16:39:56 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:39:58 tankpi reef-pi[2023]: 2019/01/19 16:39:58 ERROR: stats for id: '3' not found
Jan 19 16:39:58 tankpi reef-pi[2023]: 2019/01/19 16:39:58 ERROR: GET /api/tcs/3/usage stats for id: '3' not found
Jan 19 16:55:57 tankpi reef-pi[2023]: 2019/01/19 16:55:57 ERROR: Failed to reload reef-pi. Output:. Error: signal: terminated
Jan 19 16:55:57 tankpi reef-pi[2023]: 2019/01/19 16:55:57 ERROR: GET /api/admin/reload Failed to reload reef-pi. Output:. Error: signal: terminated
Let me know if you need any additional information.
Last edited: