Proper logging with Meteor

@arggh regarding env variables, these are no longer necessary, it was in an earlier version: all config is explicit in the application.

Regarding the logging server, the setup you describe should work, but I think it would be more efficient to have each application server receive its logs and send to a local rsyslog/syslog-ng using the SyslogSender. From there, there heavy production code from these and the File Beat on each of these servers can ship the syslog files through LogStash at whatever scale you need. Iā€™d rather avoid a meteor app server do this kind of centralization when it can be done in pure C code by a long-time-production-quality code like rsyslog.

If you go either way, Iā€™d be interested in the results.

Daily news: FiLog has now a complete JSdoc documentation to help use it.

1 Like

Sorry for my newbie question: I have trouble adding the package to my project. Whatā€™s the full package name besides filog that can be used in meteor add ā€¦ for installation?

Itā€™s a NPM package, so

meteor npm install --save filog

1 Like

Oh, right! It works. Thank you!

I wanted to try the filog package but I canā€™t install it on my Windows development platform. I get an error message when I run meteor npm install --save filog that says ā€œUnsupported platformā€.

Production environment is linux, but I of course would want to see that it works locally before deployment. Can the problem be fixed?

I need simple logging that will save server errors to a file on my production server so I can see why itā€™s crashing (works fine on the dev machine). Filog sounds good but I canā€™t figure out how to get started with it. The documentationā€™ is just a list of js filenames. I donā€™t understand from the README how to use it e.g. where would logs be stored? I must be missing something really basic about what a logger is and how it is expected to work? Thanks for any help.

filog inserts log entries into your database.

Itā€™s just what I need but I couldnā€™t install it into my app on my Windows development environment as described above.

Iā€™d be open to consider alternatives if anyone can suggest any.

Hmm, that looks potentially dangerous if your logs will be viewable in the client-side database. Iā€™d prefer something that just saves a file on the server - and I still donā€™t understand how to use it from the README. I also canā€™t tell whether it only logs your custom messages, or all server console output.

FiLog only does so, if you configure it to do so. You can also send them to a syslog server, console etc., but you can also just extend it and do whatever you want with the logs.

For that to happen you need to have a publication setup that ships those docs to clients - nothing besides the userā€™s profile from your database is sent to the client by default (I hope, do check that you donā€™t have autopublish installed).

You can call logger.arm() to make the FiLog logger catch exceptions and log them, but if you just call console.log('cowabunga'); in your code, itā€™s got nothing to do with FiLog.

@arggh, thank you for the information, it sounds like Filog may be what I need. However I tried to install Filog under Linux Mint Cinnamon with the command recommended above (shouldnā€™t this be in the README?):


meteor npm install --save filog

But I got errors:


bcrypt_lib.target.mk:97: recipe for target 'Release/obj.target/bcrypt_lib/src/blowfish.o' failed
make: *** [Release/obj.target/bcrypt_lib/src/blowfish.o] Error 127
make: Leaving directory '/home/username/Meteor/myapp/node_modules/filog/node_modules/bcrypt/build'
gyp ERR! build error 
gyp ERR! stack Error: `make` failed with exit code: 2
gyp ERR! stack     at ChildProcess.onExit (/home/username/.meteor/packages/meteor-tool/.1.6.0_1.f9l6vk++os.linux.x86_64+web.browser+web.cordova/mt-os.linux.x86_64/dev_bundle/lib/node_modules/node-gyp/lib/build.js:258:23)
gyp ERR! stack     at emitTwo (events.js:126:13)
gyp ERR! stack     at ChildProcess.emit (events.js:214:7)
gyp ERR! stack     at Process.ChildProcess._handle.onexit (internal/child_process.js:198:12)
gyp ERR! System Linux 4.4.0-53-generic
gyp ERR! command "/home/username/.meteor/packages/meteor-tool/.1.6.0_1.f9l6vk++os.linux.x86_64+web.browser+web.cordova/mt-os.linux.x86_64/dev_bundle/bin/node" "/home/username/.meteor/packages/meteor-tool/.1.6.0_1.f9l6vk++os.linux.x86_64+web.browser+web.cordova/mt-os.linux.x86_64/dev_bundle/lib/node_modules/npm/node_modules/node-gyp/bin/node-gyp.js" "rebuild"
gyp ERR! cwd /home/username/Meteor/myapp/node_modules/filog/node_modules/bcrypt
gyp ERR! node -v v8.9.3
gyp ERR! node-gyp -v v3.6.2
gyp ERR! not ok 
npm WARN enoent ENOENT: no such file or directory, open '/home/username/Meteor/myapp/package.json'
npm WARN myapp No description
npm WARN myapp No repository field.
npm WARN myapp No README data
npm WARN myapp No license field.

npm ERR! code ELIFECYCLE
npm ERR! errno 1
npm ERR! bcrypt@0.8.7 install: `node-gyp rebuild`
npm ERR! Exit status 1
npm ERR! 
npm ERR! Failed at the bcrypt@0.8.7 install script.
npm ERR! This is probably not a problem with npm. There is likely additional logging output above.

Any idea how I can install Filog?

That looks like a problem with bcrypt. Can you open an issue on the filog repository with steps to reproduce ?

Problems compiling native addons like bcrypt usually mean youā€™re missing one of node-gyp's dependencies, being:

  • python (v2.7 recommended, v3.x.x is not supported)
  • make; and
  • A proper C/C++ compiler toolchain, like GCC

Did a roundup and evaluation of logging libraries about 6 months agoā€¦
https://www.loggly.com/blog/meteor-logging-quickstart/

3 Likes

@awatson1978 : did you have a chance to examine filog since then ? As the package maintainer, Iā€™d be really interested to have feedback from someone who examined alternatives.

It should be able to log to Loggly with minimal effort, since it includes syslog, or a loggly ā€œSenderā€ could be added.