Home / server / Questions / 311856
In Process
JanKanis
Asked: 2011-09-16 09:04:15 +0800 CST

portable unix way to join strings with separator

  • 772

Is there a portable unix shellscripting way of joining a number of strings together with a given separator, like so:

$ strjoin --- foo bar baz quux
foo---bar---baz---quux

Sure I could use a $scripting_language one liner or an ugly explicit loop in a shellscript function, but the unix hackers of old probably had some need for this as well, so someone has made a standard command like this that I don't know about somewhere in the past, right?

edit

The sed method is certainly the easiest one in many situations, but it doesn't work if the strings can contain spaces. And many of the other answers also don't handle that. Are there any solutions other than the $IFS trick that handle spaces (and all possible characters in general) and do not require writing a full loop?

unix-shell strings

7 Answers

  1. For multi-character long separator, you can use:

    • sed (as already pointed by @Mark)

      $ echo foo bar baz quux | sed "s/ /---/g"

    • ex

      $ echo foo bar baz quux | ex +"s/ /---/gp" -cq! /dev/stdin
$ ex +"s/ /---/gp" -scq! <(echo foo bar baz quux)

    • printf (but it will show the extra ending separator)

      $ printf "%s---" foo bar baz quux

    • using the following shell function (as per this SO post):

      join_by { local IFS="$1"; shift; echo "$*"; }

      Usage:

      $ join_by '---' foo bar baz quux

    For one-character long separators, you can use:

    • tr

      echo foo bar baz quux | tr ' ' '-'
    • 17

  2. Perl is not that complex for simple operations:

    $ perl -e 's/ /---/g'
    • 1

  3. lam

    Here is the example using lam command:

    $ SEP="---"; lam <(echo foo) -s$SEP <(echo bar) -s$SEP <(echo baz) -s$SEP <(echo quux)
foo---bar---baz---quux

    paste

    If the separator is one character long, then paste command can be used:

    $ printf "%s\n" foo bar baz quux | paste -sd-
foo-bar-baz-quux
    • 1

  4. In addition to @embobo's comment (which will hopefully make it into an answer soon), perl can be used to split and join arbitrary strings. This is more complex than using sed and based on the example above would be major overkill.

    • 0

  5. awk version:

    function join(a, start, end, sep, result, i) {
    sep = sep ? sep : " "
    start = start ? start : 1
    end = end ? end : sizeof(a)
    if (sep == SUBSEP) # magic value
       sep = ""
    result = a[start]
    for (i = start + 1; i <= end; i++)
        result = result sep a[i]
    return result
}

    Call it with gawk with --source is your strings:

    $ gawk -f join.awk --source 'BEGIN { split("foo bar quux",a); print join(a,1,3,"---") }'
foo---bar---quux

    Shell script version:

    function join() {
    for i in "$@"; do
        echo -n "$i""---"
    done
    echo
}

join foo bar baz quux

    Call it and trim the last separator:

    $ ./join.sh | sed 's/\-\-\-$//'
foo---bar---baz---quux
    • 0

  6. The best method I've found is the ugly explicit loop you mentioned.

    join(){
    # If no arguments, do nothing.
    # This avoids confusing errors in some shells.
    if [ $# -eq 0 ]; then
        return
    fi

    local joiner="$1"
    shift

    while [ $# -gt 1 ]; do
        printf "%s%s" "$1" "$joiner"
        shift
    done

    printf '%s\n' "$1"
}

    Usage:

    $ join --- foo bar baz quux
foo---bar---baz---quux

    Tested with Bash, Dash, and Zsh on Ubuntu, and should work in other Bourne-based shells.

    • 0 
  7. python -c 'import sys; print "__".join(sys.argv[1:])' a b c
    
function join_by() {
    local L_IFS=$1
    shift
    python -c "import sys; print(\"$L_IFS\".join(sys.argv[1:]))" "$@"
}
    • 0