WernerCD's questions

TL;DR: Web tasks taking longer than 5 minutes through an Apache ReverseProxy errors out. Tasks/reports of shorter duration succeed. Directly accessing reports succeeds (http://internalserver/foobar.aspx instead of http://public.mycompany.com/foobar.aspx). Where should I be looking and what timeouts am I missing?

I have an Apache Instance that is switching to HTTPS then ProxyPassing a request along it's merry way... into an Windows Server 2012 R2 IIS 8 instance.

Browser <==> 
Apache 2.2.15 <==> 
IIS 8 (Windows 2012 R2, IIS 8.5.9600.16384) <==> 
Web App (<==> database)

Everything is going just cheeky - until a "long running" report is kicked off. When run directly on the Windows server, the report takes ~6 minutes. When run from the Browser, shorter reports succeed - but this one eventually fails.

Web Page Error:

502 Proxy Error

Proxy Error

The proxy server received an invalid response from an upstream server.
The proxy server could not handle the request GET /app/LongRunningReport.aspx.

Reason: Error reading from remote server

ssl_error:

==> ssl_error_log <==
[Wed Nov 04 14:59:48 2015] [error] [client 192.168.1.225] (104)Connection reset by peer: proxy: error reading status line from remote server 192.168.1.179
[Wed Nov 04 14:59:48 2015] [error] [client 192.168.1.225] proxy: Error reading from remote server returned by /app/LongRunningReport.aspx

ssl.conf:

LoadModule ssl_module modules/mod_ssl.so
Listen 192.168.1.101:443
SSLPassPhraseDialog  builtin
SSLSessionCache         shmcb:/var/cache/mod_ssl/scache(512000)
SSLSessionCacheTimeout  1200
SSLMutex default
SSLRandomSeed startup file:/dev/urandom  256
SSLRandomSeed connect builtin
SSLCryptoDevice builtin
<VirtualHost 192.168.1.101:443>
  ErrorLog logs/ssl_error_log
  TransferLog logs/ssl_access_log
  LogLevel warn
  SSLEngine on
  SSLProtocol all -SSLv2 -SSLv3
  SSLCipherSuite ECDH+AESGCM:DH+AESGCM:ECDH+AES256:DH+AES256:ECDH+AES128:DH+AES:ECDH+3DES:DH+3DES:RSA+AESGCM:RSA+AES:RSA+3DES:!aNULL:!MD5:!DSS
  SSLCertificateFile conf.d/ssl.crt/test.crt
  SSLCertificateKeyFile conf.d/ssl.key/test.key
  SSLCertificateChainFile conf.d/ssl.crt/2015.crt
  SSLCACertificateFile conf.d/ssl.crt/Company_Root_CA.cer
  <Files ~ "\.(cgi|shtml|phtml|php3?)$">
    SSLOptions +StdEnvVars
  </Files>
  <Directory "/var/www/cgi-bin">
    SSLOptions +StdEnvVars
  </Directory>
  CustomLog logs/ssl_request_log "%t %h %{SSL_PROTOCOL}x %{SSL_CIPHER}x \"%r\" %b"

  ServerName test.company.com
  RedirectMatch ^/$ https://test.company.com/app/login.aspx

  SSLProxyEngine on
  ProxyPass        / https://192.168.1.179/
  ProxyPassReverse / https://192.168.1.179/

  SetEnv force-proxy-request-1.0 1
  SetEnv proxy-nokeepalive 1
  SetEnv proxy-initial-not-pooled 1

  TimeOut 1200
  ProxyTimeout 1200
</VirtualHost>
SSLInsecureRenegotiation off
SSLHonorCipherOrder on

IIS Settings:
Advanced Settings > Limits > Connection Time-out (seconds): 1200
Session State > Cookie Settings > Timeout (in minutes): 20

We've tried increasing all the Timeout settings we can to 1200 (20 minutes) - inside Apache and IIS.

What am I missing? What can be causing a proxyerror message between Apache and IIS?

We are setting up an internal program, on an internal server that uses the private 172.30.x.x subnet... when we ping the address 172.30.138.2, it routes across the internet:

C:\>tracert 172.30.138.2
Tracing route to 172.30.138.2 over a maximum of 30 hops

  1     6 ms     1 ms     1 ms  xxxx.xxxxxxxxxxxxxxx.org [192.168.28.1]
  2     *        *        *     Request timed out.
  3    12 ms    13 ms     9 ms  xxxxxxxxxxx.xxxxxx.xx.xxx.xxxxxxx.net [68.85.xx.xx]
  4    15 ms    11 ms    55 ms  te-7-3-ar01.salisbury.md.bad.comcast.net [68.87.xx.xx]
  5    13 ms    14 ms    18 ms  xe-11-0-3-0-ar04.capitolhghts.md.bad.comcast.net [68.85.xx.xx]
  6    19 ms    18 ms    14 ms  te-1-0-0-4-cr01.denver.co.ibone.comcast.net [68.86.xx.xx]
  7    28 ms    30 ms    30 ms  pos-4-12-0-0-cr01.atlanta.ga.ibone.comcast.net [68.86.xx.xx]
  8    30 ms    43 ms    30 ms  68.86.xx.xx
  9    30 ms    29 ms    31 ms  172.30.138.2

Trace complete.

This has a number of us confused. If we had a VPN setup, it wouldn't show up as being routed across the internet. If it hit an internet server, Private IP's (such as 192.168) shouldn't get routed.

What would let a private IP address get routed across servers? would the fact that it's all comcast mean that they have their routers setup wrong?

I'm trying to list the size of all files on a volume group in AIX 5.3. I need to backup a volume group and I need to determine if it will fit on the tapes I have available.

This question lists 'pvdisplay' and 'pvs' which aren't available in AIX it seems.

I have a custom function that I'm working on... the problem I'm having is simple: Permssions.

example function:

drop function circle_area
go

CREATE FUNCTION  circle_area (radius FLOAT)
RETURNS FLOAT LANGUAGE SQL
BEGIN
     DECLARE pi FLOAT DEFAULT 3.14;
     DECLARE area FLOAT;

     SET area =  pi * radius * radius;
     RETURN area;
END
GO

if I then log out of my "admin" account... and log into test account I get a "Not authorized" error when I try to run something "Select circle_area(foo) from library.bar".

I can log into iSeries Navigator, navigate to schema > functions > permissions and change the permission for public from Exclude to All. bam it works.

How do I grant permission to all, either in the CREATE FUNCTION or after?

Okay... Not sure how "out there" this thought is...

Right now to send a pager message (aka text message), a user logs into our AS400... logs into the program... enters user name and message and hit's F10 to send.

With a little looking, it seems that you can run remote commands to the AS400 via FTP. So I'm working on building a script (batch or otherwise) that, given two parameters (user, message), will FTP into the AS400 and run a remote command:

c:\>ftp server
user: admin
password: *****
ftp> quote rcmd SNDPGRMSG TOPGR(JDOE) MSG('This is a Test')
ftp> quit

So... what I want to do is

setup an email account on our Exchange server
Monitor the account for incoming mail
upon receipt of incoming mail, parse it... say for example subject is defined as "Recipient" and email text is defined as "Pager message"
run a batch that uses the above mentioned TOPGR and MSG as parameters... via FTP to the AS400
mark email as "read"

The main thing I'm not sure about is monitoring an exchange account and running a script on incoming emails. I'm sure what I want to do is possible... but where would I start?

EDIT: Clarification

The main reasons for using this four part system are logging (messages sent via this are logged and reported by the AS400 program) and the existing scheduler for redirecting pages (For example, the weekly on-call person = TOPGR(oncall) gets updated by the AS400 program).

I'm also trying to remove duplicate work. If I can get this setup working, I can redirect pages from OTHER systems into this one. I then don't have to update 2, soon to be 3, systems with current phone numbers, carriers, on-call schedules, etc. System #2 and #3 can just "email" [email protected].

On the AS400 I want to remotely execute:

strpgrprg topgr(userx) message(ALERT!)

What options are available to me?

update: I want to run a AS400 program from outside of the AS400. I want to execute this command (or similar) from a windows batch, or a linux shell script.

I've found some info on how-to via FTP. Just haven't tried it out and still looking to see if it's the best way to do it.

I'm trying to track a process that locks up regularly. It's a funky program that we have no control over. I'm trying to find a good way to track when the program stops responding.

I have a query which has a result... It comes back with 2 numbers: an integer and a time. The integer is "Items in Queue" and the time is "Time last item was processed".

What I'm trying to find out... is what is the best way to get these result into the Zabbix Database? How can I query SQLServer\DatabaseX either once to populate two items... or twice to seperately fill these two Items? Can I use Zabbix to run a Stored Procedure (which can be set to return whatever) and return that info via Agent?

IF I can get the result of a stored procedure... can I update two Items with one result or would i have to have two queries?

I have Zabbix Server on Ubuntu working... I have an Agent install on my Windows server. Template_Windows works wonders and gives me all sorts of stats that I'm happy to play with...

The problem is that I'm trying to monitor an application. Not a service or a website. An application.

I have one application that likes to crash unexpectedly. I'd like to be able to get a "Program is not responding" alert (and then funnel that into email/sms/reports).

I've got another server with an application that I'd like to monitor stats (CPU usage, etc).

I see how-to monitor services... but these aren't services. They are applications that run while a "User" is logged in. I can't quite find a good tutorial on how to setup something like this.

Edit: Doing further research and tinkering... The question is becoming: Irregardless of the method, how do I detect that an application is frozen/hung/not-responding?

• Use Proc_Counter and detect if there is zero activity for say... 15 seconds?
• Use a perf_info metric? I don't seem to see anything in it that would indicate a hung process, but the only man page I can find is 1.4 and current Zabbix is 1.8.4.
• VBScript, command-line test, etc that monitor/test's application with an output that can be tracked via UserParameters?

I can't seem to get something working. Once I can verify a hung process I can respond with task-kill/restart, email responsible party, etc... but I just can't seem to find a graceful way to detect a hung process/application.

I'm looking to see if there is a good "Best Fit" solution for what I'm being asked to deliver.

The IT company I work for contracts to a local business. While we have been long term partners, recently we have signed a long term, updated agreement with this business. One of the things that they want is downtime tracking.

There are a LOT of options out there for downtime tracking... enough that I'd like to ask the experts what my best options are.

I want to track downtime at the __ level:

• Server - When did it go down. Why. How long.
• Connection - Tracking ISP, Phone, Server to Server connections... Server is acting fine, but "downtime" was caused because someone hit the pole that holds the line between two sites.
• application - Server is fine. Connection is fine. But application stops responding. We have servers that have anywhere between 1 and many applications on it.
• Also wanting to track bad/extreme lag in downtime. This includes all the above. Server/Connection/App is running... but it takes 5 minutes for a page load... or a document to print.

Some of the applications we want to track are home-grown, making it possible to add test parts/procedures for application level tracking of downtime. Some applications are web based making it possible to use simple, periodic web-page loads to track downtimes... but we have many closed applications that are going to be tricky, if not plain impossible, to write tests for.

So what I'm thinking is that, unfortunately, I'm going to need a system that has an "easy" way to add or edit downtime statistics.

Given a diverse set of OS's (Windows, Unix, AIX, DB2), connections, and applications... what is a good platform to use to track this information in a way that's as automated as possible BUT still easy to manually edit where required... with appropriate reporting options.

I'm looking at Zabbix now... Just wondering if it's even remotely in the right area of what I want/need.

I'm a bit rusty on my AS400-Fu... never really used it much honestly.

I have a report (or 5) on a system that I have access too... how would I go about locating said report(s) and more detailed information about them.

I'm not sure how the reports are generated (RPG, SQL, etc), but I have the name of the report and some other basic information.

I need to find the report so I can research the information and logic that creates it. From the database/table it pulls info from. To the selection criteria.

On windows and Linux I'd use stuff like find, search, file extension, file explorer, etc to find the file and get information about the file and associated processes and go from there. Can't seem to put my finger on search button for the AS400.

Edit: Ideas from below:

@JamesA

wrkobj *ALL/PBRP581* *PGM

Object      Type      Library     Attribute   Text                       
PBRP581     *PGM      FCSOLIB     RPGLE       Outsourcing - Acct Placement

DSPPGM FCSOLIBD/PBRP581

Program PBRP581 in library FCSOLIBD not found.