• 0

On an EC2 instance in an ECS cluster, SNMP filesystem monitoring alerts on docker filesystems

Sam Gendler


SNMP based monitoring of an EC2 instance that is a member of an ECS cluster picks up filesystems at  /var/lib/docker/containers/<container_id> which go away once the docker container exits.  This causes logicmonitor to alert on the 'StorageNotAccessible' data point of the 'Filesystem Capacity' data source.  Does anyone have a good fix for this that doesn't just turn off monitoring of those filesystems?  And do I care, anyway?  They seem to be some kind of overlay filesystem that is just content on a normal filesystem that is also being monitored, so I can probably just exempt /var/lib/docker/containers/* from being monitored at all, though I'd love to have it do that automatically just for hosts that are AWS/EC2 instances.  I'll eventually figure out how to do that via the documentation, but it may be faster to ask here.

Incidentally, there seem to be 2 kinds of mounts with that path pattern, one shared memory segment and the other overlay.  It looks like logicmonitor ignores shm filesystems.  Perhaps it could ignore overlay by default, too?

Link to comment
Share on other sites

0 answers to this question

Recommended Posts

There have been no answers to this question yet

Join the conversation

You can post now and register later. If you have an account, sign in now to post with your account.

Answer this question...

×   Pasted as rich text.   Paste as plain text instead

  Only 75 emoji are allowed.

×   Your link has been automatically embedded.   Display as a link instead

×   Your previous content has been restored.   Clear editor

×   You cannot paste images directly. Upload or insert images from URL.