FLM03E stops sending data to flukso.net

by gebhardm on

Todays, exacly 02:00 CEST my FLM03E stopped sending data to the flukso.net portal. This is the second time in two days that it refuses to pass on any data. MQTT locally works fine and but corresponding TMPO values are not logged. Syslog tells:

  1. Apr 15 01:30:40 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523755520: No space left on device
  2. Apr 15 01:34:35 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523755776: No space left on device
  3. Apr 15 01:39:02 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523756032: No space left on device
  4. Apr 15 01:42:53 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523756288: No space left on device
  5. Apr 15 01:45:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 5955 cmd /usr/bin/fcheck
  6. Apr 15 01:47:03 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523756544: No space left on device
  7. Apr 15 01:51:17 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523756800: No space left on device
  8. Apr 15 01:55:31 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523757056: No space left on device
  9. Apr 15 02:00:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6024 cmd /usr/bin/fcheck
  10. Apr 15 02:00:02 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523757312: No space left on device
  11. Apr 15 02:00:26 flukso-bf5612 daemon.notice netifd: wan (771): Sending renew...
  12. Apr 15 02:00:26 flukso-bf5612 daemon.notice netifd: wan (771): Lease of 192.168.0.55 obtained, lease time 3600
  13. Apr 15 02:04:19 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523757568: No space left on device
  14. Apr 15 02:08:37 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523757824: No space left on device
  15. Apr 15 02:12:41 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523758080: No space left on device
  16. Apr 15 02:15:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6105 cmd /usr/bin/fcheck
  17. Apr 15 02:17:11 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523758336: No space left on device
  18. Apr 15 02:20:59 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523758592: No space left on device
  19. Apr 15 02:25:42 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523758848: No space left on device
  20. Apr 15 02:29:51 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523759104: No space left on device
  21. Apr 15 02:30:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6176 cmd /usr/bin/heartbeat 0
  22. Apr 15 02:30:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6177 cmd /usr/bin/fcheck
  23. Apr 15 02:30:02 flukso-bf5612 user.info heartbeat[6180]: POST <a href="https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:" title="https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:">https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:</a> 200
  24. Apr 15 02:30:26 flukso-bf5612 daemon.notice netifd: wan (771): Sending renew...
  25. Apr 15 02:30:26 flukso-bf5612 daemon.notice netifd: wan (771): Lease of 192.168.0.55 obtained, lease time 3600
  26. Apr 15 02:34:07 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523759360: No space left on device
  27. Apr 15 02:38:18 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523759616: No space left on device
  28. Apr 15 02:42:54 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523759872: No space left on device
  29. Apr 15 02:45:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6266 cmd /usr/bin/fcheck
  30. Apr 15 02:47:29 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523760128: No space left on device
  31. Apr 15 02:51:16 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523760384: No space left on device
  32. Apr 15 02:55:56 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523760640: No space left on device
  33. Apr 15 02:59:32 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523760896: No space left on device
  34. Apr 15 03:00:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6343 cmd /usr/bin/fcheck
  35. Apr 15 03:00:27 flukso-bf5612 daemon.notice netifd: wan (771): Sending renew...
  36. Apr 15 03:00:27 flukso-bf5612 daemon.notice netifd: wan (771): Lease of 192.168.0.55 obtained, lease time 3600
  37. Apr 15 03:03:48 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523761152: No space left on device
  38. Apr 15 03:08:22 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523761408: No space left on device
  39. Apr 15 03:12:06 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523761664: No space left on device
  40. Apr 15 03:15:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6416 cmd /usr/bin/fcheck
  41. Apr 15 03:17:03 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523761920: No space left on device
  42. Apr 15 03:20:54 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523762176: No space left on device
  43. Apr 15 03:25:11 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523762432: No space left on device
  44. Apr 15 03:29:24 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523762688: No space left on device
  45. Apr 15 03:30:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6493 cmd /usr/bin/heartbeat 0
  46. Apr 15 03:30:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6494 cmd /usr/bin/fcheck
  47. Apr 15 03:30:02 flukso-bf5612 user.info heartbeat[6497]: POST <a href="https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:" title="https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:">https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:</a> 200
  48. Apr 15 03:30:27 flukso-bf5612 daemon.notice netifd: wan (771): Sending renew...
  49. Apr 15 03:30:27 flukso-bf5612 daemon.notice netifd: wan (771): Lease of 192.168.0.55 obtained, lease time 3600
  50. Apr 15 03:33:26 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523762944: No space left on device
  51. Apr 15 03:38:10 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523763200: No space left on device
  52. Apr 15 03:42:05 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523763456: No space left on device
  53. Apr 15 03:45:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6577 cmd /usr/bin/fcheck
  54. Apr 15 03:46:40 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523763712: No space left on device
  55. Apr 15 03:51:06 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523763968: No space left on device
  56. Apr 15 03:55:31 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523764224: No space left on device
  57. Apr 15 03:59:14 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523764480: No space left on device
  58. Apr 15 04:00:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6654 cmd /usr/bin/fcheck
  59. Apr 15 04:00:27 flukso-bf5612 daemon.notice netifd: wan (771): Sending renew...
  60. Apr 15 04:00:27 flukso-bf5612 daemon.notice netifd: wan (771): Lease of 192.168.0.55 obtained, lease time 3600
  61. Apr 15 04:03:36 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523764736: No space left on device
  62. Apr 15 04:08:00 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523764992: No space left on device
  63. Apr 15 04:12:41 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523765248: No space left on device
  64. Apr 15 04:15:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6727 cmd /usr/bin/fcheck
  65. Apr 15 04:16:42 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523765504: No space left on device
  66. Apr 15 04:21:15 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523765760: No space left on device
  67. Apr 15 04:25:06 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523766016: No space left on device
  68. Apr 15 04:29:04 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523766272: No space left on device
  69. Apr 15 04:30:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6804 cmd /usr/bin/heartbeat 0
  70. Apr 15 04:30:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6805 cmd /usr/bin/fcheck
  71. Apr 15 04:30:03 flukso-bf5612 user.info heartbeat[6806]: POST <a href="https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:" title="https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:">https://api.flukso.net/device/bf5612ba4b21bbe6540d8d4fab3a480d:</a> 200
  72. Apr 15 04:30:28 flukso-bf5612 daemon.notice netifd: wan (771): Sending renew...
  73. Apr 15 04:30:28 flukso-bf5612 daemon.notice netifd: wan (771): Lease of 192.168.0.55 obtained, lease time 3600
  74. Apr 15 04:34:05 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523766528: No space left on device
  75. Apr 15 04:38:06 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523766784: No space left on device
  76. Apr 15 04:42:23 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523767040: No space left on device
  77. Apr 15 04:45:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6888 cmd /usr/bin/fcheck
  78. Apr 15 04:46:32 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523767296: No space left on device
  79. Apr 15 04:50:33 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523767552: No space left on device
  80. Apr 15 04:55:31 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523767808: No space left on device
  81. Apr 15 04:59:31 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523768064: No space left on device
  82. Apr 15 05:00:01 flukso-bf5612 cron.info crond[1007]: crond: USER root pid 6965 cmd /usr/bin/fcheck
  83. Apr 15 05:00:28 flukso-bf5612 daemon.notice netifd: wan (771): Sending renew...
  84. Apr 15 05:00:28 flukso-bf5612 daemon.notice netifd: wan (771): Lease of 192.168.0.55 obtained, lease time 3600
  85. Apr 15 05:03:41 flukso-bf5612 daemon.err tmpod[1457]: /usr/sbin/tmpod.lua:329: /flukso//tmpo/sensor/8c406fd15914033582d243f5405f268e/0/8/1523768320: No space left on device

Ok, wasn't there a round robin for TMPO?

AttachmentSize
Screenshot_TMPO_query.png56.18 KB
‹ cant edit sensors Gas sensor stopped working ›
gebhardm's picture
gebhardm |

And why is the independent flukso-posting stopped?! This is another daemon, isn't it?

gebhardm's picture
gebhardm |

It is sending again: April 16, 2018, 17:47 CEST :-)
A full flash memory prevented any activity... Many thanks, Bart, for cleaning up! But what was the root cause?

icarus75's picture
icarus75 |

Root cause seems to be the tmpod not cleaning up the block20's in time for the block8's to be written to flash. I've slightly modified your FLM's tmpod. This will force tmpod to perform a flash check every second. Should the issue occur again, shout!

gebhardm's picture
gebhardm |

:-) I will let you know, silently... Thanks!!!