Home / user-56130

coneybeare's questions

Martin Hope
coneybeare
Asked: 2014-11-29 17:04:30 +0800 CST
  • 0

I have URL http://foo.com/bar?abc=123, what would be the correct entry in the htaccess file to return a simple text 200 status of abc=123? Basically, I just want to return the entire query string as simple text.

I know return ing text is possible because I have used it with ErrorDocument before, and I know accessing the query is possible with QUERY_STRING, I just don't know how to combine the two in a RewriteRule.

apache-2.2
Martin Hope
coneybeare
Asked: 2014-11-25 07:01:12 +0800 CST
  • 2

In my .htaccess I have

ErrorDocument 404 http://foo.com/404.html

It works, in the sense that I recover from any file not found error and show the 404 page instead, but the way it works is to redirect the erroneous URI using a 301 to my 404.html page.

This is bad because search engines and crawlers will not end up seeing a 404 code, rather a 301 code and will not purge deleted pages from their indices.

Can I make Apache serve up the contents of this 404 page upon file not found errors, yet still return a 404 code instead of the 301?

apache-2.2
Martin Hope
coneybeare
Asked: 2014-08-16 07:01:50 +0800 CST
  • 1

I have my Solr/Jetty up and running well on Ubuntu 12.04. I am trying to hookup my monit conf to monitor it, but it is having trouble connecting to the service.

I have Solr running on port 8983 and can connect via http://localhost:8983/solr/, but cannot connect via localhost, 127.0.0.1, or 0.0.0.0 in my monit conf file.

Monit conf file:

check process solr with pidfile "/var/run/jetty.pid"
start program = "/usr/sbin/service jetty start"
stop program = "/usr/sbin/service jetty stop"
    if failed host 127.0.0.1 port 8983 protocol http then restart
    if totalmem is greater than 7268 MB for 10 cycles then restart
    if 5 restarts within 5 cycles then timeout

Netstat:

root@ip-10-110-37-29:~# netstat -lnp | grep 8983
tcp        0      0 0.0.0.0:8983            0.0.0.0:*               LISTEN      16033/java

I have tried different permutations of if failed lines, but always get the following monit errors in my logs:

'solr' failed, cannot open a connection to INET[localhost:8983] via TCP

What am I doing wrong here?

ubuntu
Martin Hope
coneybeare
Asked: 2011-06-13 18:11:03 +0800 CST
  • 2

I have a media site and problems of users coming along and scraping all of the content.I placed a invisible URL on the page to catch spiders that immediately blocks the ip, but some people have figured out the URL scheme and are creating their own scripts.

All the fail2ban filters I have seen thus far deal with failed login attempts, but I desire one that will be more advanced and will detect, then rate-limit and/or block abusers. The urls the scrapers use are all valid, so if they go slow enough, I won't be able to tell, but I imagine I can keep the amateurs out through fail2ban.

How can I implement this filter in fail2ban the right way while minimizing my false positives on legit users?

apache-2.2 rate-limiting scraping fail2ban block
Martin Hope
coneybeare
Asked: 2011-02-15 18:19:06 +0800 CST
  • 3

I am trying to clean out some of the log clutter from my machines and am starting by removing requests that are generated from the server themselves. I have cache warmers running around the clock and I don't want these polluting the logs.

I was able to get apache to stop logging local requests by adding a dontlog for the local IP:

SetEnvIf Remote_Addr "RE\.DA\.CT\.ED" dontlog
CustomLog "|logger -p local3.info -t http" combined env=!dontlog

and now I am looking for something similar to put in a configuration for the Haproxy log. How can I prevent 127.0.0.1 requests from writing to the Haproxy log?




UPDATE: 2/15/11

I use the excellent loggly service to pull out logs in the cloud, but I am seeing tons of logs like this:

2011 Feb 15 06:09:42.000 [REDACTED] http: RE.DA.CT.ED - - [15/Feb/2011:06:09:42 -0500] "HEAD /search/Nevad/predictive/txt HTTP/1.0" 200 - "-" "Wget/1.10.2 (Red Hat modified)"
2011 Feb 15 06:09:42.000 127.0.0.1 haproxy[10390]: 127.0.0.1:58408 [15/Feb/2011:06:09:42] www i-5dd7a331.0 0/0/0/8/8 200 210 - - --NI 0/0/0 0/0 "HEAD /search/Nevad/predictive/txt HTTP/1.1"

and I want them gone. This question focuses on how to remove that haproxy log line from writing to the server side log in the first place.

logging apache-2.2 log-files haproxy
Martin Hope
coneybeare
Asked: 2010-10-22 14:13:14 +0800 CST
  • 36

I have some cloud boxes that change their IP frequently.

I ssh using the hostname but have to edit the known_hosts file every time the server launches because of this error message:

@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
@    WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED!     @
@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@
IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY!
Someone could be eavesdropping on you right now (man-in-the-middle attack)!
It is also possible that the RSA host key has just been changed.
The fingerprint for the RSA key sent by the remote host is…

Aside from any security risks and such that are associated with what I want to do, is there a way to either ignore this error or overwrite the known_hosts file automatically such that I don't always have to edit it myself?

bash ssh known-hosts fingerprint
Martin Hope
coneybeare
Asked: 2010-10-05 19:59:25 +0800 CST
  • 5

I have the following lines pertaining to logging in my Apache vhost file

SetEnvIf Request_URI "^/server-status$" dontlog
SetEnvIf Request_URI "^/haproxy-status$" dontlog
SetEnvIf Request_Method "OPTIONS" dontlog
CustomLog /var/log/apache2/access_log combined env=!dontlog
#ErrorLog  /var/log/apache2/error_log

#Remote logging -- handle by syslog
ErrorLog "|logger -p local3.info -t httperror"
CustomLog "|logger -p local3.info -t http" combined env=!dontlog

LogLevel warn

I don't really want to mess anything up as to where I won't be getting my logs properly, but I don't want to see duplicate lines for every entry either. Currently, If I make one request, I see one line for Apache, then one line which I assume is haproxy forwarding it to my app, similar to this:

aa.bbb.ccc.dd - - [05/Oct/2010:02:29:51 +0000] "GET /the_url HTTP/1.1" 200 4 "-" "-"
eee.fff.gg.hh - - [05/Oct/2010:02:29:51 +0000] "GET /the_url HTTP/1.1" 200 4 "-" "-"
aa.bbb.ccc.dd - - [05/Oct/2010:02:31:03 +0000] "GET /another_url HTTP/1.1" 200 4 "-" "-"
eee.fff.gg.hh - - [05/Oct/2010:02:31:03 +0000] "GET /another_url HTTP/1.1" 200 4 "-" "-"

What should I do to prevent this?

logging apache-2.2