I am trying to discover all IPv6 hosts on my MASSIVE business network (like a /32 block).
I have an nmap script I think that works but sadly only for my local subnet. Would this work if I changed my subnet to include all LANs?
Do you know any better ways to discover IPv6 hosts?
So basically what I want to do is use a grep,sed or awk command (I'm not picky) that can do the following. I know how to go from Vuln 1 to OS1 but not vice versa.
Input:
test.txt
Vuln 1
OS1
OS2
OS3
Vuln 2
OS4
OS5
Output (heavy pseudocode):
$ grep "OS1" test.txt
Vuln 1
This is the code I wrote to resolve DNSs and output to a file. Is there a way to forgo the while loop entirely and just write in awk? It works perfectly but it seems very cumbersome and inefficient, takes about 10 mins for 25k lines of IPs. Will gladly elaborate on script if clarity is needed.
#!/bin/bash
while read line; do
echo -en " ${startCount} / ${endCount} IPs resolved\r"
ip=$(echo ${line} | cut -d "," -f1)
col2=$(nslookup ${ip} | fgrep "name" | sed -e 's/\t/,/g' -e 's/name = //g' -e 's/.uncc.edu.//g' | cut -d "," -f2)
if [[ ! -z ${col2} ]]; then
echo "${line}" | awk -F"," -v var="${col2}" '{print $1","var","$2","$3","$4","$5","$6}' >> ${outFile}
else
echo "${line}" | awk -F"," '{print $1",""UNRESOLVED"","$2","$3","$4","$5","$6}' >> ${outFile}
fi
((startCount++))
done < ${1}
Just as the title says, Google gives me nothing and I can't test it on this server.
The command as is follows:
tail -f <file> | fgrep --line-buffered "string" | sed -u 's/stuff//g' >> output.log
Do I need to use kill -SIGTERM <PID> or kill -SIGKILL <PID> to stop a tail -f?
I've been scouring forums for a few hours and cannot find a concrete explanation on how to use rsyslog. I really just need the basics.
I have a log file logFile.log and I want to forward the logs to server2 on port 514. How would I setup rsyslog to do this? I will provide any extra information as needed.
Here's my command that I'm using in a script to grep real-time data. It doesn't seem to pull real-time data correctly as it just misses some lines.
tail -f <file> | fgrep "string" | sed 's/stuff//g' >> output.txt
What would the following command do? What is "line buffering"?
tail -f <file> | fgrep --line-buffered "string" | sed 's/stuff//g' >> output.txt
This is more a conceptual thing than a current problem.
Would it be possible to do this:
tail -f <file> | grep "string" | sed 's/stuff//g' >> output.txt
The problem I'm thinking is that tail -f never terminates so it won't progress in the command. I'm trying to read and output a file in real-time. If this doesn't work how would I do it?
I'm writing a script and here's how i'm inputting into the CurrentOutput.csv file.
echo "$col1,$col2" >> CurrentOutput.csv
Input.txt
1.2.3.4
2.3.4.5
3.4.5.6
CurrentOutput.csv
1.2.3.4
,DNS1
2.3.4.5
,DNS2
3.4.5.6
,DNS3
DesiredOutput.csv
1.2.3.4,DNS1
2.3.4.5,DNS2
3.4.5.6,DNS3
I've tried echo -e "$col1,$col2\c" and echo -n "$col1,$col2". Is it because I'm writing from a .txt file to a .csv file? What am I missing here?
When I run nslookup on an IP (These are all examples)
nslookup 192.168.1.123
Current output:
41.31.211.111
Desired output:
111.211.31.41
I have a script that works just seeing if there's a more efficient way or a built-in nslookup command.
file1.csv
A,,C,D
A,,C,D
A,,C,D
A,,C,D
file2.csv
A,B
A,B
A,B
A,B
desired Output.csv
A,B,C,D
A,B,C,D
A,B,C,D
A,B,C,D
I've tried using "join" and "paste" to no avail. Is there a bash command to do this? Column "A" is the same in both .csv files.
Here's what I have:
cat UserReport.txt | mail -s "TestSubject" "[email protected]"
It's a small file, much smaller than a picture so it should send almost instantly. Though I receive nothing. I installed mailutils but might have installed it incorrectly.
How can I send an email from a bash script?
How do I get from this:
randomcollege-nt\user90
to this:
user90
using sed?
I have a file that needs sorting in a specific way but I can't figure out how to do it.
I've tried the following command but it doesn't give me what I want:
sort -t" " -k1,1 Original_File | uniq -d > Desired_Output
Original_File:
User1 US
User1 NG
User2 US
User3 US
User4 US
User4 EN
User5 US
Desired_Output:
User1 US
User1 NG
User4 US
User4 EN
So basically what I want to do is compare two file by line by column 2. How could I accomplish this?
File_1.txt:
User1 US
User2 US
User3 US
File_2.txt:
User1 US
User2 US
User3 NG
Output_File:
User3 has changed
I have two files and I'm trying to join them at a certain spot. I'd like to join them at the fourth column of the second file using the first column of the first. It's driving me nuts!
Here is what I'm trying:
join -j4 <(sort -k1 FirstFile.txt) <(sort -k4 SecondFile.txt)
FirstFile.txt:
24.136.152.171 US
24.136.152.171 US
24.136.152.171 US
SecondFile.txt
2014-08-03 00:00:00 User 24.136.152.171
2014-08-03 00:00:00 User 24.136.152.171
2014-08-03 00:00:00 User 24.136.152.171
Desired Output:
2014-08-03 00:00:00 User 24.136.152.171 US
2014-08-03 00:00:00 User 24.136.152.171 US
2014-08-03 00:00:00 User 24.136.152.171 US
Why does my shell and subshell only print the first hour in my for loop? It's supposed to loop through all 24 hours in a day but only prints the first hour correctly.
{
for D in $(seq -f "%02g" 1 9); do
File=($(find -name "PaloAlto_traffic_$M-$D-$Y.zip"))
unzip -j $File
Filetmp=($(find -name "traffic_$M-$D-$Y.total"))
D=$(echo $D | sed -e 's/^0*//')
for i in $(seq -f "%02g" 0 23); do
echo $i
grep -F -s "$month $D $i:" $Filetmp > TempOutput1.txt
countAllow=($(grep -F -c 'allow' TempOutput1.txt))
countDeny=($(grep -F -c 'deny' TempOutput1.txt))
#Add new 'variable=($(grep)) statement here'
echo -e "$M/0$D/$Y $i:00,$countAllow,$countDeny" >> AD-Results-$month-$Y
echo "$((10#$i+1))/24 hours completed for $month $D"
rm -f $Filetmp
done
done
} & #Subshell 2A
{
for D in $(seq -f "%02g" 10 18); do
File=($(find -name "PaloAlto_traffic_$M-$D-$Y.zip"))
unzip -j $File
Filetmp=($(find -name "traffic_$M-$D-$Y.total"))
for i in $(seq -f "%02g" 0 23); do
grep -F -s "$month $D $i:" $Filetmp > TempOutput2.txt
countAllow=($(grep -F -c 'allow' TempOutput2.txt))
countDeny=($(grep -F -c 'deny' TempOutput2.txt))
#Add new 'variable=($(grep)) statement here'
echo -e "$M/$D/$Y $i:00,$countAllow,$countDeny" >> AD-Results-$month-$Y
echo "$((10#$i+1))/24 hours completed for $month $D"
rm -f $Filetmp
done
done
}
wait
Sample output data: (Date Time , Allow , Deny)
05/10/2014 00:00,3242,6758
05/10/2014 01:00,0,0 #This should be the same as above line but outputs 0,0
Why does this line do nothing? I'm trying to run a "sed" command in parallel and it outputs nothing to "standard.txt"
$Filetemp = the file I'm stream editing
standard.txt = the file I'm outputting to
cat $Filetemp | parallel --pipe sed -e "s/[[:space:]]\+/ /g" > standard.txt
This is the original code that works just fine but takes way too long:
sed -e "s/[[:space:]]\+/ /g" $Filetmp > standard.txt
GNU Parallel Version: 20130922
Lubuntu 14.04
Which shell command is the fastest way to parse through millions of lines of text. Currently I'm using GREP in my script but it takes hours upon hours to finish.
Sample Input:
May 1 2014 00:00:00 Allow
May 1 2014 00:00:00 Allow
May 1 2014 01:00:00 Deny
May 1 2014 01:00:00 Deny
May 1 2014 02:00:00 Allow
May 1 2014 02:00:00 Deny
Sample Output:
(where "2" in line one is 'grep -c "allow" ' and "0" is 'grep -c "deny" ')
May 1 2014 00:00:00,2,0
May 1 2014 01:00:00,0,2
May 1 2014 02:00:00,1,1
How do I get a bash script to run in full screen when it's executed or how can I change the terminal size if I can't make it full screen?
I have some sample data below (call it test.txt). I would like to split this big document into 3 documents by searching the first two digits in the 4th column. I'm pretty new with Linux (Lubuntu 14.04) and have looked into 'csplit' and 'awk' but can't seem to get the syntax down for either. (I'm writing BASH scripts)
test.txt
12-1-2014 Allow 00:00:00 00:00:00
12-1-2014 Allow 00:00:00 00:00:00
12-2-2014 Allow 01:00:00 01:00:00
12-10-2014 Deny 01:00:00 01:00:00
12-10-2014 Deny 02:00:00 02:00:00
12-11-2014 Deny 02:00:00 02:00:00
test1.txt
12-1-2014 Allow 00:00:00 00:00:00
12-1-2014 Allow 00:00:00 00:00:00
test2.txt
12-2-2014 Allow 01:00:00 01:00:00
12-10-2014 Deny 01:00:00 01:00:00
test3.txt
12-10-2014 Deny 02:00:00 02:00:00
12-11-2014 Deny 02:00:00 02:00:00