JasCav's questions

I am attempting to debug, what I think is, an IIS rewrite issue.

I am hosting multiple sites on a single IIS server which is acting as a proxy to Kestrel hosts behind the scenes. That is all working correctly and I haven't been having any issues there.

The issue I am running into is when any of my sites do a return Redirect("http://www.someotherurl.com/") via ASP.NET MVC, the base URL is always rewritten to the URL of my site - this is true even if the URL is completely external to my URL.

If I run the site separately, not within the IIS proxy, the redirect works as I expect, so I know that it's something within IIS.

As far as rules, I have no outbound rules at all right now. For inbound rules, I have (for each one of my sites):

1. HTTP to HTTPS redirect rule.
2. A rewrite rule which takes the URLs and rewrites the URL to http://127.0.0.1:port so that the self-hosted services can handle the request appropriately. There is an individual rule per site.

I am very stumped at this point because I don't see any other way redirects would not go to the actual URL that I provide, but IIS seems to be doing something mysterious.

More Information

1. Request comes in for www.example.net/Documents.
2. Rule rewrites the URL to 127.0.0.1:port/Documents based on the incoming URL.
3. Endpoint handles the request.
4. A redirect response is sent.
5. The Base URL is converted back to www.example.com no matter what - even if the redirect is to a different domain. I believe this is where the problem is occurring. It seems like IIS does this by default. I'm not sure, however.

My coworker and I are attempting to setup a two node "cluster" in which each node needs to access a file on the first node. To make this simple (it's a dev environment), he created a network share in which the entire X drive on the first machine is shared (Everyone > All Rights). So, ultimately, I can get to the file by accessing \\xxx.xxx.xxx.xxx\X\filename.txt.

What's interesting, though, is that, while I can access the first machine from itself by using the IP address, or localhost, I cannot access it by using the name I gave it (which I resolve using the hosts file on both machines). \\my.machine.name\X\filename.txt gives me a login dialog (which I can't login with using the local account OR a domain account). However, the other machine can use \\my.machine.name\X\filename.txt and it can access the share fine. It's very confusing, and I haven't been able to figure out what's causing it.

Both boxes are Windows 2012. The account I am using is a local account (on both machines - same account name). The IPs are static. Both machines are running inside VMWare's vCloud and are in the same vapp. Any insight or even a good way to debug this would be much appreciated.

I have had a 10 node HBase cluster up and running for the past 4 months. The cluster was setup on VMs in a corporate environment which I do not control, but everything has been working great...until today.

Today, every part of the system was down. I restarted the system and everything came back up for a bit, but then would go down again (particularly HBase...but I think that was because of this following issue).

There is an error in the HDFS logs that says:

HdfsCanaryCdh4{hdfs://hbase-1.internal:8020} for hdfs://hbase-1.internal:8020: Failed to read /tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_15-17_39_25. Error: org.apache.hadoop.ipc.RemoteException(java.lang.NullPointerException): java.lang.NullPointerException
    at org.apache.hadoop.hdfs.server.blockmanagement.DatanodeManager.sortLocatedBlocks(DatanodeManager.java:334)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getBlockLocations(FSNamesystem.java:1343)
    at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getBlockLocations(NameNodeRpcServer.java:413)
    at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getBlockLocations(ClientNamenodeProtocolServerSideTranslatorPB.java:172)
    at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java:44938)
    at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:453)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1002)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1752)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1748)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1438)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1746)

When I jump onto the Name Node and run:

sudo -u hdfs hdfs dfs -cat /tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_15-17_39_25

I get back a single line that says: cat: java.lang.NullPointerException.

I also double checked that the disks weren't full (they aren't) and that I have connectivity (everything appears normal - nobody has touched this system as I was the only one with access).

I am completely stumped what is happening here. I can provide more details if needed, but I'm not even sure where to go from here.

Update

Per Mark's request in the comments, the output of:

sudo -u hdfs hdfs dfs -lsr /tmp/

is

drwxrwxrwx   - hdfs supergroup          0 2014-04-16 09:48 /tmp/.cloudera_health_monitoring_canary_files
-rw-rw-rw-   3 hdfs supergroup         56 2014-04-15 16:59 /tmp/.cloudera_health_monitoring_canary_files/.canary_file_2014_04_15-16_59_24
[continues like this for all the files in the directory]

As I am setting up Hadoop, one question keeps popping in my mind but I can't find the answer.

Which Hadoop configuration files need to be copied to which nodes. For example, I'm making changes to the following files:

hadoop-env.sh, core-site.xml, mapred-site.xml, hdfs-site.xml, masters, slaves

Do I need to copy these files to ALL my Hadoop nodes (which is kind of a pain if I update one file). Do only certain files need to be copied? Or, do I only need to make the changes on my master nodes?

Can't seem to find the answer anywhere, so I wanted to ask here. (Up to this point, I have been mirroring all the files across every node, but that seems inefficient. My setup does work.)

I am adding new projects to Redmine after transitioning it to a new server. The projects appear to add correctly. I can also add new CRs and DRs. However, after they are added, I can't actually browse to them. For example:

http://redmine.mysite.com/projects/myproject/issues

Gives me an Internal error. Same with the Calendar, Gantt charts and backlog. The issues are apparently added, though, because I can see a list of all issues by going to:

http://redmine.mysite.com/issues

What is interesting is that I can still select the old issues and they work. The issues added to new projects do not work.

When I check my logs (both Apache and Redmine logs) there is no apparent problems being reported. I'm really not sure where to go next from here. Any suggestions?

Update for Apache Configuration

It looks like this:

LoadModule passenger_module /usr/local/lib/ruby/gems/1.8/gems/passenger-3.0.9/ext/apache2/mod_passenger.so
PassengerRoot /usr/local/lib/ruby/gems/1.8/gems/passenger-3.0.9
PassengerRuby /usr/local/bin/ruby

<VirtualHost *:80>
  ServerName redmine.mysite.com
  ServerAdmin [email protected]
  DocumentRoot "/opt/redmine/latest/public"
  LogFormat "%h %l %u %t \"%r\" %>s %b" common
  LogLevel WARN
  ErrorLog "/var/log/httpd/redmine-error.log"
  CustomLog "/var/log/httpd/redmine-access.log" common

  <Directory /opt/redmine/latest/public>
    Options Indexes ExecCGI FollowSymlinks -MultiViews
    Order allow,deny
    Allow from all
    AllowOverride all
  </Directory>

  <Location />
    Include conf.d/auth_kerb.inc
    Require ldap-attribute objectclass=person
  </Location>
</VirtualHost>