GLUSTERFS CLIENT LOG FILES ARE HUGE

This is an issue I recently fixed on our GlusterFS installation, but I didn’t see anything directly on Google for lazy people like myself. The issue is that the log files in /var/log/glusterfs are HUGE. Ours ended up being > 30 GB after about a day and ended up causing issues since the filesystem of our container filled up. Our log files were lots of: [2016-08-24 13:51:20.776255] I [dict.c:370:dict_get] (–>/usr/lib/x86_64-linux-gnu/glusterfs/3.5.2/xlator/performance/md-cache.so(mdc_lookup+0x2ff) [0x7fd05c6e4c6f] (–>/usr/lib/x86_64-linux-gnu/glusterfs/3.

Read more

TROUBLESHOOTING WONKY ZABBIX REPORTS

I rely on Zabbix to keep tabs on all of my machines and to make sure all of The Storehouse is working perfectly. It’s always troubling to wake up to 30+ emails from Zabbix and is pretty good cause for alarm. Turns out, these things were fairly innocuous and the sign of a pretty simple issue and related to the backup of that VM. I’ll try to outline the steps I used to diagnose and lessons I learned along the way.

Read more

BUILDING A CUSTOM OPENVZ TEMPLATE

One of the things I’ve thought would be handy for much too long was setting up a custom template for my virtual machines. I don’t do anything too crazy, but I use LDAP and some other utilities that I continually have to setup and configure on every machine. The ultimate in convenience would be to create a new virtual machine and have all the environment specific config done, so I can get right into building it out.

Read more

ROBO AS A PHP TASK RUNNER

One of the things I ran into when developing The Storehouse was the need for a task runner that fit into my weird style of development. I’m not really a fan of having multiple tools that do the same thing, so consolidating all of my dependencies into Composer was a goal of mine once I started needing task runners. At first, I started off using Gulp and Node.js to do task running.

Read more