The fastest way to identify any mysterious text or analyze strings from a file, just ask `lemmeknow` !

Identify any mysterious text or analyze strings from a file, just ask lemmeknow.

Information

Category: Rust / Text processing
Watchers: 2
Star: 14
Fork: 0
Last update: Sep 6, 2021

Resource links

https://docs.rs/lemmeknow/

https://github.com/swanandx/lemmeknow

README
Issues 6

The fastest way to identify anything

lemmeknow ⚡

Identify any mysterious text or analyze strings from a file, just ask lemmeknow.

lemmeknow can be used for identifying mysterious text or to analyze hard-coded strings from captured network packets, malwares, or just about anything, for identifying

All URLs
Emails
Phone numbers
Credit card numbers
Cryptocurrency addresses
Social Security Numbers
and much more.

🧰 Usage

If you have the executable, then just pass TEXT or /PATH/TO/FILE as argument e.g. lemmeknow secrets.pcap and it will determine if the argument is a file or just a text and then perform analysis accordingly!

If you want output in JSON, then pass --json, e.g. lemmeknow UC11L3JDgDQMyH8iolKkVZ4w --json

🔭 Installation

Download executable 📈

You can directly download executable and run it. No need for any installation.

Check releases here.

Using `cargo` 🦀

cargo install lemmeknow

Build it from source 🎯

Clone repository

git clone https://github.com/swanandx/lemmeknow && cd lemmeknow

then build and run

cargo run e.g. cargo run -- <TEXT/FILENAME> [OPTIONS]

cargo build --release
cd target/release/
./lemmeknow e.g. ./lemmeknow <TEXT/FILENAME> [OPTIONS]

🙀 API

Want to use this as a crate in your project? or make a web api for it? No worries! Just add a entry in your Cargo.toml

[dependencies]
lemmeknow = "0.1.0"

[dependencies]
lemmeknow = { git = "https://github.com/swanandx/lemmeknow" }

Refer to documentation for more info.

🚧 Contributing

You can contribute by adding new regex, improving current regex, improving code performance or fixing minor bugs! Just open a issue or submit a PR.

Acknowledgement

This project is inspired by PyWhat! Thanks to developer of it for the awesome idea <3 .

2 Open More issues

Closed

Configure release profile

All we need to do is add following at the end of our Cargo.toml file:

[profile.release]
lto = true
panic = "abort"

That is it!

good first issue

opened Oct 27, 2021 by swanandx 1

Closed

Add some benchmarks!

This project uses same regex database as PyWhat , we need some performance benchmarks against it <3 !

For identifying single text
For analyzing strings from a file
Calling function multiple times through API i.e. lemmeknow::what_is("text here") for lemmeknow and Identifier.identify("text") for pyWhat.

API documentations available here 😸 :-

documentation good first issue

opened Aug 30, 2021 by swanandx 1

Closed

Add support for filtering output

We have entries for Rarity and Tags in database. We need to implement a filter so that user can filter based on rarity and/or tags.

For example, lemmeknow --rarity 0.2:0.6 --tags Credentials TEXT.

making it a module will be nice idea 😄 src/output/filter.rs

enhancement

opened Aug 30, 2021 by swanandx 1

Closed

Optimize release builds & add CI checks

Add some more fields to Cargo.toml to optimize release builds more. Reference: https://nnethercote.github.io/perf-book/build-configuration.html

Also adds CI checks that run cargo check, cargo test, cargo fmt, and cargo clippy

opened Mar 14, 2022 by SkeletalDemise 0

Closed

Configured release profile

Added at the end of Cargo.toml file #3

[profile.release]
lto = true
panic = "abort"

opened Oct 28, 2021 by st0rm2 0

Open

proposal: use `SmallVec` instead of `Vec` for buffer

The idea is to use smallvec for buffer while extracting strings from file. We only consider the strings which are longer than 4 characters, so for other strings, which we are going to reject anyway, we can avoid heap allocation caused due to buffer vector. here.

let mut buffer: SmallVec<[u8; 4]> = smallvec![]; // TODO: change 4 to more optimal number

So, what to do?

Change Vec to SmallVec
Experiment with different sizes ( at least 4 will be good imho, but we should try other using quasi-doubling strategy , i.e. 4, 8, 16, 32 )
Benchmark the code to see if it actually improves performance.
Choose the one with best performance. ( post the results here or while making PR )

It would be amazing if you can post benchmark of all sizes, then we can choose the most optimal.

enhancement

opened Mar 15, 2022 by swanandx 0

Easily run Python at the shell! Magical, but never mysterious.

easier than regex string matching patterns for urls and other strings. turn strings into data or data into strings.

A Python library that provides an easy way to identify devices like mobile phones, tablets and their capabilities by parsing (browser) user agent strings.

vue-identify-network - ⚡️Identify what kinda internet your users are using!

Not the fastest terminal colors library. Don't even ask about size.

The Big List of Naughty Strings is a list of strings which have a high probability of causing issues when used as user-input data.

The simplest, fastest way to get business intelligence and analytics to everyone in your company :yum:

Convert strings between different cases.

Chad Strings - The Chad way to handle strings in C.

This plugin makes it easy to search text in strings resources.

Code and yara rules to detect and analyze Cobalt Strike

Ask me stuff

Simplyfied utility class to ask marshmallow permissions

Simpliest way to ask runtime permissions on Android, no need to extend class or override permissionResult method, choose your way : Kotlin / Coroutines / RxJava / Java7 / Java8

Text to speech is a process to convert any text into voice (using Python)

java source code static code analysis and danger function identify prog

Utilities for processing user-agent strings. Can be used to handle http requests in real-time or to analyze log files.

Ask Buddie Discord server bot to manage the server with some useful commands and automation.

git peek is the fastest way to open a remote git repository in your local text editor.

header-only library to validate utf-8 strings at high speeds (using SIMD instructions)

Compress JSON into URL friendly strings

Share this repo

Related Repos

Text processing

Create archives of files within Garry's Mod

gm_zip Create archives of files within Garry's Mod. Note: The scope of this module only works accross the gmod installation files e.g from GarrysMod/g

Text processing

Bulk edit files

Text processing

Rust implementation of the EDN data format

edn_format This crate provides an implementation of the EDN format for rust. The intent is to provide a more complete api than the existing edn and ed

Text processing

cookies? cookies.

cookies? cookies. println!("{}", Cookie + Cookie); // yum yum! 🍪 🍪 println!("{}", Cookie ); // just got 1 🍪 :/ println!("{}", Cookie * 10); // 10

Text processing

Grep with human-friendly search output

hgrep: Human-friendly GREP hgrep is a grep tool to search files with given pattern and print the matched code snippets with human-friendly syntax high

Text processing

Print pacman package files

Paccat Print pacman package files Usage paccat [options] <targets> -- <files> a target can be specified as <pkgname>, <repo>/<pkgname>, <url> or <file

Text processing

Display strings in a safe platform-appropriate way

os_display Printing strings can be tricky. They may contain control codes that mess up the message or the whole terminal. On Unix even filenames can c

Text processing

List of the links to the docs for different services, which explain using of advanced sear...

Search operators for mailbox Google https://support.google.com/mail/answer/7190?hl=en Yahoo https://www.lifewire.com/search-messages-yahoo-1174487 Out

Text processing

The fastest way to identify any mysterious text or analyze strings from a file, just ask `...

Identify any mysterious text or analyze strings from a file, just ask lemmeknow.

Text processing

Imagine the information security compliance guideline says you need an antivirus but you r...

libredefender Imagine the information security compliance guideline says you need an antivirus but you run Arch Linux. libredefender is an antivirus p

Text processing

An experimental proofreading and linting language server for markdown files ✍️

prosemd is an experimental proofreading and linting language server for markdown files. It aims to provide helpful and smart diagnostics when writing

Text processing

A simple rust library to extract code blocks from Markdown files

Simple rust library and CLI to extract code blocks marked with triple backticks from markdown files into source files.

Text processing

A self-describing data interchange format

This describes the nachricht data model and wire format, for documentation of the actual Rust crates, see the docs. nachricht nachricht is a self-desc