A tool for structural code search and replace that supports ~every language.

comby See the usage documentation. A short example below shows how comby simplifies matching and rewriting compared to regex approaches like sed. Need help writing patterns or have other problems? Consider po

Information

Category: Linux / Miscellaneous
Watchers: 23
Star: 2.1k
Fork: 57
Last update: May 19, 2023

Resource links

https://github.com/comby-tools/comby

comby

See the usage documentation.

A short example below shows how comby simplifies matching and rewriting compared to regex approaches like sed.

Comby supports interactive review mode (click here to see it in action).

Need help writing patterns or have other problems? Post them in Gitter.

Install (pre-built binaries)

Mac OS X

brew install comby

Ubuntu Linux

bash <(curl -sL get.comby.dev)
Arch and other Linux: The PCRE library is dynamically linked in the Ubuntu binary. For other distributions, like Arch, a fixup is needed: ln -s /usr/lib/libpcre.so /usr/lib/libpcre.so.3. Alternatively, consider building from source.

Windows

Install the Windows Subsystem for Linux and install Ubuntu. Then run bash <(curl -sL get.comby.dev)

Docker

docker pull comby/comby

click to expand an example invocation for the docker image

Running with docker on stdin:

docker run -a stdin -a stdout -a stderr -i comby/comby '(:[emoji] hi)' 'bye :[emoji]' lisp -stdin <<< '(👋 hi)'

Or try it live.

Isn't a regex approach like sed good enough?

Sometimes, yes. But often, small changes and refactorings are complicated by nested expressions, comments, or strings. Consider the following C-like snippet. Say the challenge is to rewrite the two if conditions to the value 1. Can you write a regular expression that matches the contents of the two if condition expressions, and only those two? Feel free to share your pattern with @rvtond on Twitter.

if (fgets(line, 128, file_pointer) == Null) // 1) if (...) returns 0
      return 0;
...
if (scanf("%d) %d", &x, &y) == 2) // 2) if (scanf("%d) %d", &x, &y) == 2) returns 0
      return 0;

To match these with comby, all you need to write is if (:[condition]), and specify one flag that this language is C-like. The replacement is if (1). See the live example.

Build from source

Install opam
Create a new switch if you don't have OCaml installed:

opam init
opam switch create 4.09.0 4.09.0

Install OS dependencies:
- Linux: sudo apt-get install pkg-config libpcre3-dev
- Mac: brew install pkg-config pcre
Then install the library dependencies:

git clone https://github.com/comby-tools/comby
cd comby && opam install . --deps-only -y

Build and test

make
make test

If you want to install comby on your PATH, run

make install

64 Open More issues

Closed

Simple OCaml example to run comby internal engine on a file

I am thinking to integrate Comby inside semgrep (I think comby can benefit semgrep and semgrep benefit comby), and I would like to integrate it by simply linking the Comby libraries in semgrep-core OCaml program.

I had a quick look at the .mli but could not find my way to call comby ...

Do you have a simple OCaml example of a program that just take 2 filenames, one containing a pattern and one a target source file, and that would run the core matching engine of comby on this file. Something like

let pattern = read_file "foo.pattern" in
let target = read_file "foo.c" in
let (matches_with_vars: Match.environment) = Comby.... ??? run_engine  pattern target in

opened Feb 22, 2021 by aryx 13

Closed

Reduce set of library dependency (e.g., gmp, sqlite3, libev)

Why does comby depend on gmp, sqlite3 and libev?

I would like to link with comby, but the less library dependencies it brings, the better. Would it be possible to split comby in 2 packages where one is just the core library and matcher, and another one with advanced features that requires gmp/sqlite3/libev?

opened Apr 1, 2021 by aryx 11

Closed

Use $XXX syntax for metavariable/holes instead of :[xxx]

One quick thing

If your feature request is about changing or updating :[hole] syntax, please read some of the principles and guidelines on the syntax design before posting. If not, please proceed.

I read the rational, but we want to possibly use comby inside semgrep and it's better for the user to have a consistent syntax for metavariables/hole, and semgrep uses $XXX.

Describe the solution you'd like Ideally there would be a global flag somewhere, like -syntax_hole_dollar, accessible also via the API to use $XXX instead of :[hole]

opened Mar 11, 2021 by aryx 11

Closed

OCaml 4.10 support

Describe the bug

Currently, comby has to be compiled with ocaml < 4.10

Reproducing

[camlzip.git] synchronised from git+https://github.com/rvantonder/camlzip.git#zip64
camlzip is now pinned to git+https://github.com/rvantonder/camlzip.git#zip64 (version git)
The following dependencies couldn't be met:
  - comby → hack_parallel → ppxlib < 0.9.0 → ocaml < 4.10
      base of this switch (use `--unlock-base' to force)

No solution found, exiting

Full build log reference, Mojave build

Expected behavior

Compile with ocaml 4.10 successfully

Additional context

PR ref: https://github.com/Homebrew/homebrew-core/pull/57386

opened Jul 3, 2020 by chenrui333 9

Closed

.comby files

I'm always frustrated when I need to supply several different file paths as input.

Describe the solution you'd like

Self-containing .comby file format that contains match template, rewrite template and example in one file.

if (:[cond])

---[rewrite]-----
if (1)

---[example]-----
if (fgets(line, 128, file_pointer) == Null) // 1) if (...) returns 0
      return 0;
...
if (scanf("%d) %d", &x, &y) == 2) // 2) if (scanf("%d) %d", &x, &y) == 2) returns 0
      return 0;

Additional context Or it could be a simplate - https://simplates.org/

opened Jan 21, 2020 by abitrolly 9

Closed

Fails to build on OpenBSD 6.5

Describe the bug This is not a bug with Comby per se, but I am having trouble building it on OpenBSD 6.5 because it cannot find <pcre.h> which lives here: /usr/local/include/pcre.h.

The build fails on the opam install -y pcre step.

I know nothing about OCaml, so I'm at a loss as to how to add include paths, opam doesn't seem to be looking in /usr/local/include?

Reproducing Follow README build instructions on OpenBSD 6.5.

Expected behavior With the correct dependency installed, I would expect the build to successfully complete.

Additional context Here is the full error.

Any help would be much appreciated.

opened Oct 2, 2019 by ohz10 9

Open

Difficulties connecting to comby.dev

Describe the bug Safari, Edge and Firefox currently from time to time refuse to connect to comby.dev from Germany with error messages regarding TLS Security. Safari: Safari cannot establish a secure connection. Edge: ERR_CONN_CLOSED Firefox: PR_END_OF_FILE_ERROR

Reproducing Open a browser and go to comby.dev. If you can connect, navigate around. Sometimes you will get a problem with the connection.

The problem can reliably be reproduced with curl: Running curl -L https://comby.dev --resolve 'comby.dev:443:2a09:8280:1:0:0:0:f:1705' (connecting to the Amsterdam server) results in curl: (35) LibreSSL SSL_connect: SSL_ERROR_SYSCALL in connection to comby.dev:443. Running curl -L https://comby.dev --resolve 'comby.dev:443:34.83.23.240' (connecting to the Oregon server) resolves without an issue.

Expected behavior The site opens reliably.

Additional context I'm connecting from Germany. Qualys SSL Labs shows the Amsterdam server not having security protocols in place. curl -L comby.dev reports curl: (35) LibreSSL SSL_connect: SSL_ERROR_SYSCALL in connection to comby.dev:443

opened May 24, 2023 by timvahlbrock 2

Open

A match expression followed by a rewrite expression using a named whitespace matcher produces unexpected output

Describe the bug

Running this configuration:

[foo]
match=":[1]"
rewrite=":[1]"
rule="""
where
match :[1] { ":[_~foo]" -> true },
rewrite :[1] { ":[ _]" -> "|" },
"""

Against the string one foo two three produces one | two three, whereas I would expect it to produce one|foo|two|three.

Interestingly changing the order of the match and rewrite fixes it. That is, changing the rule above to the following produces the expected output:

where
rewrite :[1] { ":[ _]" -> "|" },
match :[1] { ":[_~foo]" -> true },

Also interestingly, using the original order but using a plain space character instead of the named whitespace matcher also produces the expected out:

where
match :[1] { ":[_~foo]" -> true },
rewrite :[1] { " " -> "|" },

Reproducing

If this looks like a bug in the matcher, go to https://comby.live and paste a shared link below:

https://bit.ly/43kUxrz

opened May 23, 2023 by markrian 0

Open

Keep getting Exception: (Sys_error "xxxx.swift: Read-only file system

Describe the bug A clear and concise description of what the bug is.

I'm getting Exception: (Sys_error "xxxx.swift: Read-only file system

when trying to run the command

COMBY_M="$(cat <<"MATCH"
switch :[case] {:[body]}
MATCH
)"
COMBY_R="$(cat <<"REWRITE"
switch :[case] {:[body]@unknown default: }
REWRITE
)"
COMBY_RULE="$(cat <<"RULE"
where match :[body] {
| ":[_]@unknown default::[_]" -> false
| ":[_]" -> true
}
RULE
)"
# Install comby with `bash <(curl -sL get.comby.dev)` or see github.com/comby-tools/comby && \
comby "$COMBY_M" "$COMBY_R"  -rule "$COMBY_RULE" .swift -stats -match-newline-at-toplevel -timeout 20 -I

Reproducing

If this looks like a bug in the matcher, go to https://comby.live and paste a shared link below:

If this is not about a matcher, please describe the bug:

Expected behavior A clear and concise description of what you expected to happen.

Additional context Add any other context about the problem here.

opened Apr 6, 2023 by ShawnMa16 0

Open

Only first match is located

Describe the bug When searching for a hole in an environment, only the first match will be found, even if multiple passes would detect multiple holes in the context.

Reproducing the config below locates XYZ(); within brackets and moves it to the end of the brackets.

[XYZtoTheEnd]
match="{
      :[before]
      XYZ(:[params]);
      :[after]
}"
rewrite="{
      :[before]
      :[after]
      XYZ(:[params]);
}"

Expected behavior Given the following method, I would like to find all matches and move them to the end.

public void foo(){
    XYZ(a);
    XYZ(b);
    int a=0, b=3, c=4;
    XYZ(a,b,c);
}

My expected result would be

public void foo(){
    int a=0, b=3, c=4;
    XYZ(a);
    XYZ(b);
    XYZ(a,b,c);
}

however I end up with the following, because the brackets are no longer inspected once a match is found.

public void foo(){
    XYZ(b);
    int a=0, b=3, c=4;
    XYZ(a,b,c);
    XYZ(a);
}

Additional context It seems uncertain to me whether this is a bug or the expected behavior; if it isn't a bug, I'm curious how one would achieve the result I'm looking for. The reason brackets are necessary is that there are multiple methods in the file which need to be arranged in this way, rather than collecting all the matches in one place.

opened Mar 30, 2023 by Nikoraito 1

Open

builds for arm64

@rvantonder would you welcome a PR that builds releases for arm64? We're currently working on this at SG to get it integrated into our new bazel builds and building it in our tool chain is proving complicated.

I'd be happy to do the work and setup the PR.

Dave

opened Feb 21, 2023 by davejrt 2

Open

comby 1.8.1 failed to build against ocaml 5.0.0

while trying to ocaml to 5.0.0, found an issue while regression build comby 1.8.1

⬇ retrieved ocaml-variants.4.12.0+domains  (git+https://github.com/ocaml-multicore/ocaml-multicore.git#4.12+domains)
[ERROR] The compilation of ocaml-variants.4.12.0+domains failed at "make -j9".

#=== ERROR while compiling ocaml-variants.4.12.0+domains ======================#
# context              2.1.4 | macos/arm64 |  | https://opam.ocaml.org#0fd96b90
# path                 /private/tmp/comby-20230219-29540-15z8nt/comby-1.8.1/.opam/default/.opam-switch/build/ocaml-variants.4.12.0+domains
# command              /opt/homebrew/Library/Homebrew/shims/mac/super/make -j9
# exit-code            2
# env-file             /private/tmp/comby-20230219-29540-15z8nt/comby-1.8.1/.opam/log/ocaml-variants-30048-4d85a2.env
# output-file          /private/tmp/comby-20230219-29540-15z8nt/comby-1.8.1/.opam/log/ocaml-variants-30048-4d85a2.out
### output ###
# [...]
# cc -c -O2 -fno-strict-aliasing -fwrapv -Wall -Wdeclaration-after-statement -fno-common -g  -D_FILE_OFFSET_BITS=64 -D_REENTRANT -DCAML_NAME_SPACE   -DCAMLDLLIMPORT= -DNATIVE_CODE -DTARGET_arm64 -DMODEL_default -DSYS_macosx   -o clambda_checks.n.o clambda_checks.c
# cc -c -O2 -fno-strict-aliasing -fwrapv -Wall -Wdeclaration-after-statement -fno-common -g  -D_FILE_OFFSET_BITS=64 -D_REENTRANT -DCAML_NAME_SPACE   -DCAMLDLLIMPORT= -DNATIVE_CODE -DTARGET_arm64 -DMODEL_default -DSYS_macosx   -o afl.n.o afl.c
# cc -c -O2 -fno-strict-aliasing -fwrapv -Wall -Wdeclaration-after-statement -fno-common -g  -D_FILE_OFFSET_BITS=64 -D_REENTRANT -DCAML_NAME_SPACE   -DCAMLDLLIMPORT= -DNATIVE_CODE -DTARGET_arm64 -DMODEL_default -DSYS_macosx   -o bigarray.n.o bigarray.c
# fiber.c:233:53: error: use of undeclared identifier 'Wosize_gc_regs'
#     value* bucket = caml_stat_alloc(sizeof(value) * Wosize_gc_regs);
#                                                     ^
# 1 error generated.

opened Feb 19, 2023 by chenrui333 2

A tool for scan and replace file content. Instead of global search and replace, it can specify replace scope

A list of projectional and structural editors

Structural, syntax-aware search for Go code for VS Code.

Generic file search & replace tool, written in Python 3

VolumeGAN - 3D-aware Image Synthesis via Learning Structural and Textural Representations

The (Official) PyTorch Implementation of the paper "Deep Extraction of Manga Structural Lines"

:memo: PHNotepad is a simple Java text/code editor (notepad) written in Java. It has also nice features such as Search tool, Find/Replace text/code, Auto completion, Nice Image Buttons for better UX, etc.

search and replace 🎉 .

A Python-based application demonstrating various search algorithms, namely Depth-First Search (DFS), Breadth-First Search (BFS), and A* Search (Manhattan Distance Heuristic)

amber - A code search and replace tool

structural load combination library for JavaScript and Node.js

A Facebook Messenger Bot that supports Voice Recognition, Natural Language Processing and features such as: search nearby restaurants, search trending news, transcribe and save memos to the cloud.

gitbook powerful search plugin

Flay analyzes code for structural similarities. Differences in literal values, variable, class, method names, whitespace, programming style, braces vs do/end, etc are all ignored.

Find the enemy and replace them with dark power.

dssim - Measures structural similarity between images using a multi-scale variant of the SSIM algorithm

Local search for NAS

Search Git commits in natural language

Fast and differentiable MS-SSIM and SSIM for pytorch.

A RGB-D SLAM system for structural scenes, which makes use of point-line-plane features and the Manhattan World assumption.

Share this repo

Related Repos

Miscellaneous

the ultimate compact fzf gh extension

the ultimate compact fzf gh extension Installation • Usage • Customisation • Feedback gh-f is the ultimate, compact and snappy fzf extension for gh cl

Miscellaneous

MacOS Wallpapers for linux desktop

MacOS Wallpapers for linux desktop WhiteSur (Big Sur) Wallpapers Monterey Wallpapers Installation Install Gnome Backgrounds (wallpaper will change acc

Miscellaneous

A docker bundle with *arr apps ready to deploy on your linux machine.

Plex Home Media integrations This package is created for those who are not experts in linux servers and docker. If you follow these steps you'll be ab

Miscellaneous

Vim-textobj-string is a Vim plugin to provide text objects to select a string

vim-textobj-string is a Vim plugin to provide text objects (as and is by default) to select a string.

Miscellaneous

automatically quote arguments to commands like `git commit -m`

zsh-autoquoter zsh-autoquoter is a zle widget ("zsh plugin") that will automatically put quotes around arguments to certain commands. So instead of ha

Miscellaneous

PyTorchCV: A PyTorch-Based Framework for Deep Learning in Computer Vision.

PyTorchCV: A PyTorch-Based Framework for Deep Learning in Computer Vision @misc{CV2018, author = {Donny You ([email protected])}, howpubl

Miscellaneous

276

Documentation on building a HTTPS stack in AWS with HAProxy

Guidelines for HAProxy termination in AWS Document status NOT READY $Revision: $ @ 2022-01-14 19:00 PST Author Julien Vehent Review CloudOps Table of

Miscellaneous

8.3k

Spinnaker is an open source, multi-cloud continuous delivery platform for releasing softwa...

Welcome to the Spinnaker Project Spinnaker is an open-source continuous delivery platform for releasing software changes with high velocity and confid

Miscellaneous

A must-have configuration for Spacemacs users after defecting to Vim

🪐 My Neovim Configuration 🚀 A must-have configuration for Spacemacs users after defecting to Vim If you want the power of VSCode, the interactivity

Miscellaneous

This repo is for firmware updates, software files, and other important resources for the M...

Miyoo Mini Firmware and Configured SD This repository contains a debloated and improved SD card image for the Miyoo Mini. Latest Firmware Update Packa

Miscellaneous

This app is created that using with Shell Script and Zenity Library.

CV Hazırlama (Shell Script - Zenity Kütüphanesi) Linux Araçları ve Kabuk Programlama dersi kapsamında,Shell script ve Zenity Kütüphanesi kullanılarak

Miscellaneous

Docker container for PlexAutoSkip

PlexAutoSkip Official Docker Container Docker container for PlexAutoSkip Version Tags Tag Description latest Stable release Usage docker-compose ple

Miscellaneous

An open source meme???

Open source spiderman meme Haha spiderman make a presentation lol Install gimp This meme requires gimp, install through install_deps.sh chmod +x insta

Miscellaneous

Script to patch iOS app so we can later use it on Apple Silicon devices.

AppleSiliconUIKitPatch Script to patch iOS app so we can later use it on Apple Silicon devices. App should be decrypted if was downloaded from App Sto

Miscellaneous

dots configured after setting up NixOS on tmpfs

λ Idempotent Dotfiles SETTING UP NIXOS , MY WAY NixOS with tmpfs (Sway WM) Disclaimer: This is not a community framework or distribution. It's a priva