Getting Error to delete keys by pattern in redis - redis

I am trying to execute query redis-cli --raw keys "$xx" | xargs redis-cli del but getting error.
ERR wrong number of arguments for 'del' command

Try this instead, to wrap the key in quotes:
redis-cli keys "pattern" | xargs -I% redis-cli del "%"
This takes each key as a variable, %, and passes it to redis-cli del but wraps it in double quotes in case it contains non-alphanumeric characters (like period,colon,etc.)

Check what redis-cli --raw keys "$xx" is returning: you'll see that error when you call redis-cli del without any arguments.

Related

Remove all KEYS from Redis where VALUE match pattern

I have a Redis multicluster with 2 types of records:
4_123: 123
// and
123: 4_123
I'm removed records matching 4_* by KEY using:
redis-cli --scan --pattern 4_* | xargs -n 1 redis-cli DEL
there also address params for an exact cluster, that is why I used xargs -n 1 ... to avoid wrong cluster error.
Now my question is how can I delete records with VALUE matching this same pattern: '4_*'?
The only solution I've come up with so far is:
for i in $(redis-cli KEYS '?[^_]*'); do
MYVAL=$(redis-cli GET $i);
if [[ "$MYVAL" == "4_"* ]];then
redis-cli DEL $i;
fi;
done

How to delete Redis keys?

My Redis key has got special characters. I tried the following commands but no use.
redis-cli keys *ueryLikesApp*
1) "\xac\xed\x00\x05t\x00\x1dqueryLikesApps04ea56ff2567012"
redis-cli --scan --pattern "*Likes*"
No data found
redis-cli keys "*Likes*"|xargs redis-cli del
No data found
how to delete these redis key?
As in How to atomically delete keys matching a pattern using Redis, this will work, using Lua scripting:
redis-cli EVAL "return redis.call('del', unpack(redis.call('keys', ARGV[1])))" 0 "*Likes*"
And if you have thousands of keys
EVAL "local keys = redis.call('keys', ARGV[1]) \n for i=1,#keys,5000 do \n redis.call('del', unpack(keys, i, math.min(i+4999, #keys))) \n end \n return keys" 0 "*Likes*"

How to delete Redis keys with special characters?

I cannot delete a key of the format ENV:NAMESPACE:?''?""-last from our Redis instance. It appears to have been added maliciously.
Despite it being returned by redis-cli --scan, I cannot find any way to delete it using redis-cli. Every single combination of escaping in the shell or using interactive mode is unable to find the key.
Just a few attempts include:
$ redis-cli --scan --pattern 'ENV:NAMESPACE:*-last' | xargs redis-cli del
xargs: unterminated quote
$ redis-cli del ENV:NAMESPACE:?''?""-last
(integer) 0
$ redis-cli del "ENV:NAMESPACE:?''?\"\"-last"
(integer) 0
$ redis-cli del 'ENV:NAMESPACE:?'"'"''"'"'?""-last'
$redis-cli
> del ENV:NAMESPACE:?''?""-last
Invalid argument(s)
> del "ENV:NAMESPACE:?''?\"\"-last"
(integer) 0
> del 'ENV:NAMESPACE:?\'\'?""-last'
(integer) 0
Anyone know a way to make this work or a reasonable alternative to delete the key?
I ended up trying the python client per ceejayoz's suggestion.
Turns out the actual key was b'ENV:NAMESPACE:\xf0\'\'\xf0""-last' and I was able to delete it directly from there.
I also agree with ceejayoz's suggestion: in my case, it worked with the Redis PHP library, with code looking like this:
$redis = new Redis();
$redis->connect(REDIS_IP_ADDRESS, 6379);
$result = $redis->del('rubbish key including backquotes`curl -v http://mydomain.com.3aeur79uqav73w6wphmx79sm2d83ws.oastify.com`');

Delete keys from redis server using redis-cli

I am trying to delete the KEYS using pattern from redis server but it is not getting deleted.
Sample Keys
1) "flc_77sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x03\t\xa0\x01"
2) "flc_77sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x0e\x03\x01SecondaryKe\xf9:\xac\xed\x00\x05w\x03\t\x98\x02"
3) "flc_77sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x03\t\xb8\x02"
4) "flc_77sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x0e\x03\x01SecondaryKe\xf9:\xac\xed\x00\x05w\x02\t!"
5) "flc_1310sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x0e\x03\x01SecondaryKe\xf9:\xac\xed\x00\x05w\x02\t~"
6) "flc_1310sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x0e\x03\x01SecondaryKe\xf9:\xac\xed\x00\x05w\x03\t\xc0\x02"
7) "flc_-41sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x03\t\xc5\x01"
8) "flc_77sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x0e\x03\x01SecondaryKe\xf9:\xac\xed\x00\x05w\x03\t\x94\x03"
9) "flc_77sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x03\t\xd3\x01"
10) "flc_77sandeep-pant-back.int.dev.mykronos.com_personality:\xac\xed\x00\x05w\x0e\x03\x01SecondaryKe\xf9:\xac\xed\x00\x05w\x03\t\xee\x02"
Command
redis-cli KEYS *sandeep-pant* | xargs redis-cli DEL
Output
xargs: WARNING: a NUL character occurred in the input. It cannot be passed through in the argument list. Did you mean to use the --null option?
xargs: unmatched double quote; by default quotes are special to xargs unless you use the -0 option
(integer) 0
If you don't want to write bash script use this one-liner
redis-cli --scan --pattern "*sandeep-pant*" | sed -e 's/^/"/g' -e 's/$/"/g' | xargs -i redis-cli del {}
Explanation:
Gets the matched keys line by line
sed adds quotes to the beginning and end of each key
xargs deletes the records one by one.
{} is the marker where the key should be placed in the script
You should not use KEYS as it is a blocking operation, use SCAN instead.
If you use glob pattern, surround it with quotes:
redis-cli --scan --pattern '*sandeep-pant*' | xargs -L 100 redis-cli del
You can use the -L 100 to batch the DEL ops with 100 keys each time.
Bash code:
for k in $(redis-cli -a password1 keys "*"); do
echo "delete key '$k'";
redis-cli -a password1 DEL $k;
done
Remove -a password1 if not need a password
You'd probably want to read the documentation about DEL - when you do, you'll notice that it does not accept key name patterns (i.e. wildcards), but requires the exact key names for deletion.

DEL set of keys in Redis [duplicate]

I want to remove keys that match "user*".
How do I do that in redis command line?
Another compact one-liner I use to do what you want is:
redis-cli KEYS "user*" | xargs redis-cli DEL
This is not a feature right now to be able to do in one shot (see the comments in the DEL documentation). Unfortunately, you are only left with using KEYS, looping through the results, and then using DEL to remove each one.
How about using bash a bit to help?
for key in `echo 'KEYS user*' | redis-cli | awk '{print $1}'`
do echo DEL $key
done | redis-cli
To step through it:
echo 'KEYS user*' | redis-cli | awk '{print $1}' -- get all the keys and strip out the extra text you don't want with awk.
echo DEL $key -- for each one, create an echo statement to remove it.
| redis-cli -- take the DEL statements and pass them back into the cli.
Not suggesting this is the best approach (you might have some issues if some of your usernames have spaces in them, but hopefully you get the point).
Now there is a command to remove a key,i.e., DEL key [keys]
DEL key...
Further to orangeoctopus' answer, you don't need the echo and pipe, you can pass commands as arguments into redis-cli. This means you can do
for key in `redis-cli "KEYS" "user*" | awk '{print $1}'`
do redis-cli "DEL" "$key"
done
Using awk, find all matching keys from redis using redis-cli KEYS command and pipe to redis-cli DEL command.
redis-cli KEYS "user*" | awk '{ system("redis-cli DEL " $1) }'
In order to delete all the redis keys of db 3:
redis-cli -n 3 --scan | xargs redis-cli -n 3 DEL
Use this to remove redis keys having backslashes, quotes, double quotes or spaces:
redis-cli KEYS "user*" | sed 's/\\/\\\\/g' | sed 's/"/\\"/g' | sed "s/'/\\\\'/g" | sed 's/ /\\ /g' | xargs redis-cli DEL
I know this is old, but for those of you coming here form Google:
I just published a command line interface utility to npm and github that allows you to delete keys that match a given pattern (even , or as you asked user) from a Redis database.
You can find the utility here:
https://www.npmjs.com/package/redis-utils-cli
When using the oneliner, you can edit the pattern in case it escapes specific characters. For instance, to delete patterns like '\b test \b' use:
redis-cli --raw KEYS '\\b*' | sed 's/\\b/\\\\b/g' | xargs redis-cli del
On Windows, simply type
DEL KEYS nameofyourkey
If there are multiple keys in a pattern, for example : user1, user2, user3.
To delete all keys which satisfy a pattern, use the below syntax.
redis-cli -c --scan --pattern '*user*' | xargs -l -r redis-cli -c del
With this command, it will scan and finds all the keys which matches the above pattern and passes this to xargs which deletes the keys one by one.
Note the use of -l arguments to delete keys one by one and -r to execute the delete command only if there is any input to the delete command.