Home / C/C++ / Logging

Lightweight log filtering tool supporting regular expressions and instant (as-you-type) results.

Peculiar Log PeculiarLog is a lightweight log filtering tool supporting regular expressions and instant (as-you-type) results. It is designed to work with huge multi-gigabyte text files utilizing the power of Intel Hyperscan eng
Information
Category: C/C++ / Logging
Watchers: 1
Star: 137
Fork: 1
Last update: Jul 1, 2022
Resource links
https://github.com/alexhude/PeculiarLog

Peculiar Log

PeculiarLog is a lightweight log filtering tool supporting regular expressions and instant (as-you-type) results.

It is designed to work with huge multi-gigabyte text files utilizing the power of Intel Hyperscan engine running on multiple CPU cores.

Building

You can find most recent compiled version here

Prerequisites

Since PeculiarLog is based on Intel Hyperscan engine it is expecting headers to be available at /usr/local/opt/hyperscan/include/hs and libhs.a located at /usr/local/lib

Brew is the easiest way to install Hyperscan engine.

$ brew install hyperscan

Source

When everything is set, open Xcode project to build PeculiarLog from source. Minimum requirements - Xcode 9 and Swift 4.1.

AVX512 support

In order to make it even faster on host with AVX512 instructions it is necessary to rebuild HyperScan with the following options.

$ mkdir build
$ cd build
$ cmake -DBUILD_AVX512=on -DCMAKE_BUILD_TYPE=Release -DBUILD_STATIC_AND_SHARED=on ../
$ make

Then link new libhs.a to the project or replace the one installed with Brew.

Using

Just open app, drag log file to the icon and start typing regex in the field. Use setting panel or shortcuts to change scope, toggle caseless regex or line numbers.

Patterns

There are several limitation applied to the supported regex patterns by Hyperscan.

Hyperscan supports the pattern syntax used by the PCRE library (“libpcre”), 
described at <http://www.pcre.org/>. However, not all constructs available 
in libpcre are supported. The use of unsupported constructs will result in 
compilation errors.

The version of PCRE used to validate Hyperscan’s interpretation of this 
syntax is 8.41 or above.

Shortcuts

⇧ ⌃ ↑  - increase 'before' scope
⇧ ⌃ ↓  - decrease 'before' scope
⇧ ⌘ ↑  - decrease 'after' scope 
⇧ ⌘ ↓  - increase 'after' scope 
⇧ ⌘ c  - toggle caseless regex
⇧ ⌘ l  - toggle line numbers

There is also a hint on the right side of a settings panel.

Demo

Credits

Powered by Hyperscan
Icon is taken from freeiconshop.com

0 Open More issues
Closed

App is not starting under macOS Catalina

I wanted to try your app but curently it's not working. When I'm starting it it's directly crashing :/

Process:               PeculiarLog [25755]
Path:                  /Applications/PeculiarLog.app/Contents/MacOS/PeculiarLog
Identifier:            tech.peculiar.PeculiarLog
Version:               1.0 (1)
Code Type:             X86-64 (Native)
Parent Process:        ??? [1]
Responsible:           PeculiarLog [25755]
User ID:               501

Date/Time:             2019-12-18 11:07:02.065 +0100
OS Version:            Mac OS X 10.15.1 (19B88)
Report Version:        12
Bridge OS Version:     4.1 (17P1081)
Anonymous UUID:        BE0DE314-039B-3B24-090E-66C4C879ECA3

Sleep/Wake UUID:       E571E147-075C-48D8-9843-D3A01500DA86

Time Awake Since Boot: 210000 seconds
Time Since Wake:       55000 seconds

System Integrity Protection: enabled

Crashed Thread:        0

Exception Type:        EXC_CRASH (SIGABRT)
Exception Codes:       0x0000000000000000, 0x0000000000000000
Exception Note:        EXC_CORPSE_NOTIFY

Termination Reason:    DYLD, [0x1] Library missing

Application Specific Information:
dyld: launch, loading dependent libraries

Dyld Error Message:
  Library not loaded: /usr/local/opt/hyperscan/lib/libhs.5.dylib
  Referenced from: /Applications/PeculiarLog.app/Contents/MacOS/PeculiarLog
  Reason: image not found

Binary Images:
       0x10cd5e000 -        0x10cd75ff3 +tech.peculiar.PeculiarLog (1.0 - 1) <FAFFC535-8749-329B-A2FD-CA20BD928E8B> /Applications/PeculiarLog.app/Contents/MacOS/PeculiarLog
       0x111341000 -        0x1113d1b5f  dyld (733.6) <DAFEA246-2F9A-3DCB-A37C-4246D4F92770> /usr/lib/dyld

Model: MacBookPro15,1, BootROM 1037.40.124.0.0 (iBridge: 17.16.11081.0.0,0), 6 processors, 6-Core Intel Core i9, 2,9 GHz, 16 GB, SMC 
Graphics: kHW_IntelUHDGraphics630Item, Intel UHD Graphics 630, spdisplays_builtin
Graphics: kHW_AMDRadeonPro560XItem, Radeon Pro 560X, spdisplays_pcie_device, 4 GB
Memory Module: BANK 0/ChannelA-DIMM0, 8 GB, DDR4, 2400 MHz, SK Hynix, -
Memory Module: BANK 2/ChannelB-DIMM0, 8 GB, DDR4, 2400 MHz, SK Hynix, -
AirPort: spairport_wireless_card_type_airport_extreme (0x14E4, 0x7BF), wl0: Oct 19 2019 15:33:10 version 9.113.2.0.32.5.39 FWID 01-5eb3e1fa
Bluetooth: Version 7.0.1f1, 3 services, 27 devices, 1 incoming serial ports
Network Service: USB 10/100/1000 LAN, Ethernet, en10
Network Service: Wi-Fi, AirPort, en0
Network Service: Thunderbolt Bridge, Ethernet, bridge0
USB Device: USB 3.1 Bus
USB Device: Hub
USB Device: USB2.0 Hub
USB Device: Razer DeathAdder Elite
USB Device: HyperX Virtual Surround Sound
USB Device: USB2.0 Hub
USB Device: HD Pro Webcam C920
USB Device: USB 10/100/1000 LAN
USB Device: TUSB3410 EECode Ser
USB Device: Texas Instruments USB Billboard Device
USB Device: Apple T2 Bus
USB Device: Touch Bar Backlight
USB Device: Touch Bar Display
USB Device: Apple Internal Keyboard / Trackpad
USB Device: Headset
USB Device: Ambient Light Sensor
USB Device: FaceTime HD Camera (Built-in)
USB Device: Apple T2 Controller
Thunderbolt Bus: MacBook Pro, Apple Inc., 47.3
Thunderbolt Bus: MacBook Pro, Apple Inc., 47.3
opened Dec 18, 2019 by mRs- 2

Contents

    abhirajshourya A simple take on regular expressions for beginners
    amobiz RegexGen.js is a JavaScript Regular Expression Generator that helps to construct complex regular expressions.
    lk-geimfari A library that provides regular expression patterns. If you hate to write regular expressions, then expynent can help you.
    newrelic rusty_hogs - This project provides a set of scanners that will use regular expressions to try and detect the presence of sensitive information such as API keys, passwords, and personal information. It includes a set of regular expressions by default, but will also accept a JSON object containing your custom regular expressions.
    rust-lang regex — Regular expressions (RE2 style)
    VerbalExpressions C++ regular expressions made easy
    nicholaslocascio Code for the paper Neural Generation of Regular Expressions from Natural Language with Minimal Domain Knowledge (EMNLP 2016). http://arxiv.org/abs/1608.03000
    mingrammer 🍫 A collection of common regular expressions for Go
    EvolveYourMind Regular expressions matching at compile time with TypeScript
    okdshin DNN Inference with CPU, C++, ONNX support: Instant
    siddontang a golang log lib supports level and multi handlers
    gskinner RegExr is a HTML/JS based tool for creating, testing, and learning about Regular Expressions.
    MayloIFERR RACF (Recency Aware Collaborative Filtering) is the implementation of the "Recency Aware Collaborative Filtering for Next Basket Recommendation" original paper. which is a set of collaborative filtering approaches for solving the problem of predicting the Next Basket Recommendation.
    dominictarr inspired by regular expressions but can do nested structures
    octobanana Explore, test, and check regular expressions in the terminal.
    m4ll0k SecretFinder - A python script for find sensitive data (apikeys, accesstoken,jwt,..) and search anything on javascript files
    DoTheEvo Linux file search, instant results as you type
    adamschwartz Console.log with style.
    santiblanko vue-instant - Vue instant allows you to easily create custom search controls with auto suggestions for your vue 2 applications.
    JackieDo A log reader and management tool for Laravel
    ufoym A lightweight C++ library for recursive bilateral filtering [Yang, Qingxiong. "Recursive bilateral filtering". European Conference on Computer Vision, 2012].
    Share this repo

    Related Repos


    Logging
    8
    Minimalistic logging library with threads and manual callstacks
    corporateshark 🪵 minilog Minimalistic logging library with threads and manual callstacks. Features Easy to use (2 files, C-style interface) Multiple outputs (a text
     
    Logging
    13
    dogefetch, a project made in C for doges, very project, much wow
    ali019283 dogefetch, a project made in C for doges, very project, much wow
     
    Logging
    10
    PTCLogs is a library for pretty and configurable logs.
    ptcar2009 PTCLogs is a library for pretty and configurable logs.
     
    Logging
    49
    fmtlog is a performant fmtlib-style logging library with latency in nanoseconds.
    MengRao fmtlog is a performant asynchronous logging library using fmt library format.
     
    Logging
    2.3k
    sysstat - System performance tools for the Linux operating system
    sysstat sysstat - System performance tools for the Linux operating system
     
    Logging
    390
    A high performance C++ log library, producing structured binary logs
    morganstanley Binlog A high performance C++ log library to produce structured binary logs. BINLOG_INFO("Log anything! {}, {} or even {}", 1.2f, std::vector{3,4,5}, AdaptedStruct{1, "Foo"}); Motivation Consider the following log excerpt,
     
    Logging
    617
    Asynchronous Low Latency Logging Library
    odygrd Quill Asynchronous Low Latency Logging Library Introduction Features Performance Supported Platforms And Compilers Basic Usage CMake Integration
     
    Logging
    137
    Lightweight log filtering tool supporting regular expressions and instant (as-you-type) re...
    alexhude Peculiar Log PeculiarLog is a lightweight log filtering tool supporting regular expressions and instant (as-you-type) results. It is designed to work with huge multi-gigabyte text files utilizing the power of Intel Hyperscan eng
     
    Logging
    1.9k
    Distributed storage for sequential data
    facebookarchive LogDevice LogDevice is a scalable and fault tolerant distributed log system. While a file-system stores and serves data organized as files, a log system stores and delivers data organized as logs. The log can be viewed as
     
    Logging
    1.6k
    A reliable, high-performance, thread safe, flexsible, clear-model, pure C logging library.
    HardySimpson What is zlog? zlog is a reliable, high-performance, thread safe, flexible, clear-model, pure C logging library. Actually, in the C world there was NO good logging library for applications like logback in java or log4cxx in c++. Usi
     
    Logging
    12
    HyperLogLog++ algorithm implementation in D
    tamediadigital Complete HyperLogLog++ Implementation Written in D to use in C and other languages. import hll; // creates HLL++ counter with maximal allowed precision (18) auto counter = HLL(18); // allocated size is less or equal to 2 ^^ (1
     
    Logging
    1.5k
    A simple logging library implemented in C99
    rxi log.c A simple logging library implemented in C99 Usage log.c and log.h should be dropped into an existing project and compiled along with it. The library provides 6 function-like macros for logging: log_trace(co
     
    Popular
    Logging
    14.8k
    GoAccess is a real-time web log analyzer and interactive viewer that runs in a terminal in...
    allinurl GoAccess What is it? GoAccess is an open source real-time web log analyzer and interactive viewer that runs in a terminal in *nix systems or through your browser. It provides fast and valuable HTTP statistics for sys
     
    Logging
    5.4k
    C++ implementation of the Google logging module
    google This repository contains a C++ implementation of the Google logging module. Documentation for the implementation is in doc/. See INSTALL for (generic) installation instructions for C++: basically ./autogen.sh &amp;&amp; ./configure &
     
    Logging
    932
    A very high performance distributed log service
    phaistos-networks TANK is a very high performance distributed log, inspired in part by Kafka, and other similar services and technologies. This is the second major public release, TANK 2. Read about this new public release here. Introduction You