jlfenaux's questions

I host a Rails 5 website that uses Sidekiq to manage its background jobs. The problem I have is that regularly the appendonly.aof file grows to big that it fills that whole disk where it is saved.

It there a way to limit the size of appendonly.aof ?

My redis.conf file is pretty standard

########################## GENERAL

daemonize yes pidfile /var/run/redis/redis-server.pid port 6379 tcp-backlog 511 bind 0.0.0.0

timeout 0 tcp-keepalive 0

loglevel notice

logfile /var/log/redis/redis-server.log

databases 16

########################## SNAPSHOTTING

save 900 1 save 300 10 save 60 10000 stop-writes-on-bgsave-error yes rdbcompression yes rdbchecksum yes dbfilename dump.rdb dir /var/lib/redis

########################### REPLICATION

slave-serve-stale-data yes slave-read-only yes repl-diskless-sync no repl-diskless-sync-delay 5 repl-disable-tcp-nodelay no slave-priority 100

############################ SECURITY ############################# LIMITS

maxmemory-policy noeviction

######################## APPEND ONLY MODE

appendonly yes appendfilename "appendonly.aof" appendfsync everysec no-appendfsync-on-rewrite no auto-aof-rewrite-percentage 100 auto-aof-rewrite-min-size 64mb aof-load-truncated yes

########################## LUA SCRIPTING

lua-time-limit 5000

############################ SLOW LOG

slowlog-log-slower-than 10000

slowlog-max-len 128

########################## LATENCY MONITOR

latency-monitor-threshold 0

####################### Event notification

notify-keyspace-events ""

######################### ADVANCED CONFIG

hash-max-ziplist-entries 512 hash-max-ziplist-value 64

list-max-ziplist-entries 512 list-max-ziplist-value 64

set-max-intset-entries 512

zset-max-ziplist-entries 128 zset-max-ziplist-value 64

hll-sparse-max-bytes 3000

activerehashing yes

client-output-buffer-limit normal 0 0 0 client-output-buffer-limit slave 256mb 64mb 60 client-output-buffer-limit pubsub 32mb 8mb 60 hz 10

aof-rewrite-incremental-fsync yes

I recently set up a NodeBalancer in front of a Rails 3.2.12 app. The app is served by nginx and Unicorn.

All seems to work fine, but I get a lot of errors such as these that I didn't get when I only had 1 server.

IP spoofing attack?!HTTP_CLIENT_IP="10.16.81.184"HTTP_X_FORWARDED_FOR="136.160.88.153, 192.168.255.5"
actionpack (3.2.12) lib/action_dispatch/middleware/remote_ip.rb:55:in `calculate_ip'

Here is my nginx configuration for the app.

upstream unicorn {
server unix:/tmp/unicorn.ahotu-calendars.sock fail_timeout=0;
}

server {
listen 80 default deferred;
root /home/deployer/apps/appdirectory/current/public;
if (-f $document_root/system/maintenance.html) {
return 503;
}
error_page 503 @maintenance;
location @maintenance {
rewrite ^(.*)$ /system/maintenance.html last;
break;
}

location ^~ /assets/ {
gzip_static on;
expires max;
add_header Cache-Control public;
}

try_files $uri/index.html $uri @unicorn;
location @unicorn {
proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
proxy_set_header Host $http_host;
proxy_redirect off;
proxy_pass http://unicorn;
}

error_page 500 502 503 504 /500.html;
client_max_body_size 4G;
keepalive_timeout 10;
}

Did I do something wrong in the config file?

Thank you.

I've set up apache2 to serve gziped files

AddOutputFilterByType DEFLATE text/html text/plain text/xml application/xml application/xhtml+xml text/javascript text/css application/x-javascript application/json
   BrowserMatch ^Mozilla/4 gzip-only-text/html
   BrowserMatch ^Mozilla/4.0[678] no-gzip
   BrowserMatch bMSIE !no-gzip !gzip-only-text/html
   DeflateCompressionLevel 9
   SetEnvIf User-Agent ".*MSIE.*" nokeepalive ssl-unclean-shutdown downgrade-1.0 force-response-1.0

It works perfectly when I test file on safari or chrome, or event with curl (curl --header 'accept-encoding: gzip' url), but it doesn't seem to work on IE7.

I tested with http://www.webpagetest.org/.

Am I doing something wrong ?

Thanks