I've seen many more or less related topics, but all I found discuss how to color awk output. I need to preserve the color that was provided as awk input. For example, now I have:
./some_command
(red_text) (blue_text) (green_text)
./some_command | awk -F' ' '{print $1}'
(red_text) # < but the color is standard terminal color, not red anymore
How to keep the original coloring in the awk output?
There's a similar question but solution there doesn't work for me.
We have nginx and uWSGI ad backend. We need nginx to cache the backend response according to what is in the response header.
For example, I run curl -I https://example.com/api/project_data/. Using tcpdump I see the backend responds:
HTTP/1.1 200 OK
Content-Type: application/json
Vary: Accept, Accept-Language, Origin
Allow: GET, HEAD, OPTIONS
Cache-Control: public, max-age=3600
X-Request-ID: 6aa...0d99
X-Frame-Options: DENY
X-Content-Type-Options: nosniff
Set-Cookie: longterm_session=45c6...67; Domain=example.com;
Nevertheless, the response isn't cached and nginx knoks to the backend every time the request received.
The nginx config:
http {
uwsgi_cache_path /var/local/nginx_cache levels=2:2 use_temp_path=off inactive=1h keys_zone=mycache:20m ;
....
server {
....
uwsgi_cache mycache;
uwsgi_cache_key "$request_method$request_uri";
location /api/project_data/ {
add_header X-Cache $upstream_cache_status;
add_header Pragma "public";
uwsgi_pass 127.0.0.1:49002;
include uwsgi_params;
uwsgi_cache mycache;
uwsgi_cache_key "$request_method$request_uri";
}
I duplicated uwsgi_cache just to be on the safe side because afaik some directives are not inherited into location. Also, there's x-cache: MISS in the response nginx sends to the client.
What am I doing wrong?
Assuming we have instance running, what can we run on that instance to detect whether it's x86_64 or graviton-based/ARM?
I thought about curl -s http://169.254.169.254/latest/meta-data/... but found nothing useful in this case. Also, it's possible to detect using instance type (e.g. t4g.* vs t3.*) but I'd like to have more straightforward way.
Is there any?
I need to see output on the screen and at the same time grep the output and send grep result to variable. I think it can be done with tee but I can't figure out how exactly. I tried
mycommand | tee myvar=$(grep -c keyword)
mycommand | tee >(myvar=$(grep -c keyword))
but this does not work. How should it be, preferrably without writting to files?
I'm working on something that should be really simple but hitting head against the wall second day. The URLs redirect requirements are:
/file.html => /utilities/template_handler.php?filename=file.htmlThe problem: when I request https://example.com/file.html I get r=301 to
https://example.com/utilities/template_handler.php?filename=https://www.example.com/file.html
My .htaccess:
RewriteEngine On
RewriteBase /
RewriteCond %{HTTPS} off
RewriteRule .* https://%{HTTP_HOST}%{REQUEST_URI} [R=301]
RewriteCond %{HTTP_HOST} !^www\. [NC]
RewriteRule .* https://www.%{HTTP_HOST}%{REQUEST_URI} [R=301]
RewriteRule ^(.*)\.html$ /utilities/template_handler.php?filename=$1.html [NC]
I'm using litespeed webserver but for troubleshooting purpose set up Apache too, the same result. After debug is turned on I see:
strip base: '/' from URI: '/file.html'
Rule: Match 'file.html' with pattern '.*', result: 1
Cond: Match 'on' with pattern 'off', result: -1
Rule: Match 'file.html' with pattern '.*', result: 1
Cond: Match 'domain.com' with pattern '^www\.', result: -1
Source URI: 'file.html' => Result URI: 'https://www.example.com/file.html'
Rule: Match 'https://www.example.com/file.html' with pattern '^(.*)\.html$', result: 2
Source URI: 'https://www.example.com/file.html' => Result URI: '/utilities/template_handler.php?filename=https://www.example.com/file.html'
replace current query string with 'filename=https://www.example.com/file.html'
If I comment out the last rule I have first two requirements processed correctly.
The same error if the request sent to non-www or to www but non-ssl.
I'm using yaml. So, we can use either:
!GetAtt [ WebServer, AvailabilityZone ]
!GetAtt WebServer.AvailabilityZone
Also, we can use:
!Sub 'sometext-${AWS::StackName}'
how can I use GetAtt output instead of ${AWS::StackName}, preferably using the second form of GetAtt? I do know how to use Join but I'd like to stay with Sub.
I'm trying to create a SecurityGroup which has a tag like Name: SG-StackName. This code works perfect in json:
"Resources": {
"SecurityGroup": {
"Type": "AWS::EC2::SecurityGroup",
"Properties": {
...
"Tags": [{
"Key": "Name",
"Value": {
"Fn::Join" : [ "", [
"SG-",
{ "Ref" : "AWS::StackName" }
]]
}
}
]
}
},
Now I'm trying to convert it to yaml:
Resources:
SecurityGroup:
Type: AWS::EC2::SecurityGroup
Properties:
...
Tags:
- Key: Name
- Value: !Join
- ''
- - 'SG-'
- Ref: AWS::StackName
The stack build fails with error "Key not found in Tags property". Where is the error in the template?
I need to use redirect map with quite a lot rules (2k+ lines, file size is ~200K)
I have the following settings in nginx:
map $uri $new_uri {
include /etc/nginx/conf.d/redirects.map;
}
server {
listen 80 default_server;
listen [::]:80 default_server;
# redirects
if ($new_uri) {
rewrite ^ $new_uri permanent;
}
as described here and found here. The problem : configtest fails:
nginx: [emerg] could not build map_hash, you should increase map_hash_bucket_size: 64
I tried to increase map_hash_max_size and map_hash_bucket_size to quite crazy values:
map $uri $new_uri {
map_hash_max_size 262144;
map_hash_bucket_size 262144;
include /etc/nginx/conf.d/redirects.map;
}
but still have the same error (ending exactly with '64'). I selected those values so they are bigger than the file size. I made sure I'm editing live config by adding "blabla" and see 'unknown directive'
So, how those values should be set? There's not much details in the official doc, unfortunately.
There are two companies: Client and Contractor. Both have AWS accounts. I'm looking for simple but secure way to get staff from contractor team access to client's AWS console. Yep, I'm on the Contractor's side.
The ways I can remember so far:
The third one looks like the most correct but the problem is: so far I cannot find a ready way to do so. My findings: How to Use an External ID [...] , Providing Access to AWS Accounts [...] and How to Enable Cross-Account Access to the Console. Neither of them is ready-use and rather gives you idea where to move on. Also I know Rackspace has their own solution for this purpose but was unable to find the code.
So I'll repeat: I'm looking for simple but secure way to get staff from contractor team access to client's AWS console. I will be glad to save some efforts and not to re-invent a bicycle. Do you know/have such solution?
I have an issue with custom script using exec plugin. From shell the script works well and nothing useful in /var/log/collectd.log.
LoadPlugin logfile
<Plugin logfile>
LogLevel info
File "/var/log/collectd.log"
Timestamp true
PrintSeverity true
</Plugin>
How can I debug/troubleshoot it? In the doc I found an example
-> | PUTVAL "testhost/interface/if_octets-test0" interval=10 1179574444:123:456
<- | 0 Success
But how can I run it, how can I pass my PUTVAL to collectd? The collectd does not listen any port (all the other plugins work well and send data to graphite).
Just to be clear: the problem is not to see the generated string but to make sure the particular string will be accepted.
Thank you.
p.s. the particular issue: the script returns dozens of values but one of them only get to graphite.
Trying to connect graphite with grafana. The manual says:
Url The http protocol, ip and port of your graphite-web or graphite-api install.
Where I can find either of them? I grep-ed /opt/graphite/, and the only 'graphite-web' related thing I found had relation to url I'm using to open basic graphite screen (the one with tree and graphite composer). I tried this url but got orange 'Unknown error' at grafana's 'Edit data source' (no errors in /var/log/grafana/* or the main log).
They both are on the same server, so I used http://127.0.0.1:81/graphite/ (curl shows <title>Graphite Browser</title> and frameset)
I was unable to found graphite-api at all.
grafana-4.0.1
Graphite... Well, I haven't find how to check version but it was instaslled few days ago by pip install https://github.com/graphite-project/graphite-web/tarball/master
Could anyone help, please?
Trying to use exec plugin with collectd:
/etc/collectd.conf:
...
LoadPlugin exec
...
<Plugin exec>
Exec "nobody:nobody" "/etc/collectd.d/redis_simple.sh"
</Plugin>
I've simplified /etc/collectd.d/redis_simple.sh to this:
#!/bin/bash
while sleep 10
do
echo "PUTVAL nfs/redis-6379/memcached_items-db0 interval=10 N:3043"
done
The error:
# /etc/init.d/collectd restart
Stopping collectd: [ OK ]
Starting collectd: Parse error in file `/etc/collectd.d/redis.sh', line 1308 near `<newline>': syntax error, unexpected EOL
yyparse returned error #1
configfile: Cannot read file `/etc/collectd.d/redis.sh'.
Parse error in file `/etc/collectd.d/redis_simple.sh', line 1329 near `<newline>': syntax error, unexpected EOL
yyparse returned error #1
configfile: Cannot read file `/etc/collectd.d/redis_simple.sh'.
= [ OK ]
[ OK ]
There definitely is the new line at the end of both files. No windows EOLs. Nothing in logs. No line 1329 in /etc/collectd.d/redis_simple.sh.
Any help would be appreciated.
The scaling configured according to cpu usage:
On the chart it's about 8 minutes between upscaling and 2 mins between downscalings.
We cannot upscale faster because an instance requires ~5min to launch, however I'd like to have downscaling with similar delay too. Other variables:
Default Cooldown 600
Health Check Grace Period 400
What's configured wrong here?
# grep pm.status_path /etc/php5/fpm/pool.d/www.conf
pm.status_path = /fcgi-status
nginx config:
location ~ ^/(fcgi-status|ping)$ {
access_log off;
allow 127.0.0.1;
deny all;
fastcgi_param SCRIPT_FILENAME /path/$fastcgi_script_name;
fastcgi_pass unix:/var/run/php-fastcgi/php-fastcgi.socket;
}
fastcgi_param and fastcgi_pass are the same as for the website which works.
php-fastcgi and nginx were restarted, but:
# curl http://127.0.0.1/fcgi-status -i
HTTP/1.1 404 Not Found
Server: nginx/1.10.1
Date: Tue, 18 Oct 2016 08:10:03 GMT
Content-Type: text/html
Transfer-Encoding: chunked
Connection: keep-alive
X-Powered-By: PHP/5.5.9-1ubuntu4.20
No input file specified.
This is not duplicate of this question because the error is not 'File not found' (perhaps nginx was unable to find the path) but 'No input file specified'. Please note there is php header in the response, so the answer came not from nginx but from php-fpm.
This is the only pool on the server.
What am I doing wrong?
Trying to get some disk performance metrics (in particular, using munin), found that /proc/diskstats does not exist.
Tried yum provides '*/diskstats' but nothing except munin was found.
CentOS release 6.7 (Final)
uname -a
Linux domain.com 2.6.32-042stab112.15 #1 SMP Tue Oct 20 17:22:56 MSK 2015 x86_64 x86_64 x86_64 GNU/Linux
So, how can I fix it?
Assume we've started Auto Scaling Group. Min=1 (we want to keep it as cheap as possible) max=X.
From common sense we may think that the desired capacity should be calculated, based on a load level processed by alarm rules. So why do we have to configure this value when we're starting to create an ASG? When we may want to configure it at all?
I'm unsure whether I should put this question in Serverfault or Stackoverflow.
I'm developing a script (so 'press start->search' is not an option) and try to find out a way to find where an application was installed.
I already have the app SID. Looked at
HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\App Paths and
HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\Installer\Folders but it didn't help for this app.
Creeping through the whole registry I found this path:
HKLM\SOFTWARE\Microsoft\Windows\CurrentVersion\Installer\UserData\S-1-5-18\Components\0019F09C4327ED11A893800002C0A966
Could anyone explain how can 0019F09C4327ED11A893800002C0A966 be calculated if I don't know it in advance?
I noticed that the key name here is mixed back-to-front application SID:
key 0E0D0A87 6588 CF44 08ED 156E22CA84C6
sid 78A0D0E0-8856-44FC-80DE-51E622AC486C
so I tried to search straight and reversed path numbers, just 0019F09C and reversed, but no luck.
In this question the application is PHP, but the solution should work for any app which is built according to MS rules (that is, don't just unzip itself somewhere but add proper data to the registry. I hope PHP do).
upd: screenshot to to Evan Anderson's answer
In Installing RVM manual I see a lot of lines starting with '\':
Install RVM with ruby:
$ \curl -L https://get.rvm.io | bash -s stable --ruby
I'd think it is just mistype but they repeat it many times.
So what is the reason?
How to not copy but move files from one server to another (both Linux)?
man scp didn't give me anything useful. I cannot use 'scp' then 'rm' because I must make sure the file is successfully transferred. If there is any error during transfer, the file must not be deleted.
Perhaps I should use exit code somehow, but how? Also, there are a lot of files, and if the last file fails it would be not-so-good option keep the whole bunch of successfully transferred files.
Maybe there is something besides SCP?
#cat sample
1 -1 2
2 2 2
2 1-1 3
I need to get all the lines that contains negative value, that is 1st line only. Values are tab-separated. First I tried
# grep "\-1" sample
1 -1 2
2 1-1 3
But if I try
grep "\t\-1" sample
I get nothing (no match). What am I doing wrong?