automatically download the latest ip ranges used by MS Azure Datacenters
I see MS has provide website where you can download the public ip ranges used by MS Azure.
The question is, is there a way to download the XML file from that site automatically using Python or other scripts? I am trying to schedule a task to grab the new IP range file and process it .
Thanks,
Adi
Adi Polak
shared this idea
Thank you for the feedback. We now have a report that is generated weekly on Mondays: Azure Service Tags JSON (https://www.microsoft.com/en-us/download/details.aspx?id=56519). This file includes all of the Service Tags and data by regions. This is an improvement over previous files as it includes tagging by Service Tag. We recommend you move to using this file and check weekly for updates. The file is broken out by Cloud (I.e. Public) and region (i.e., West US 2). We will take the RSS Feed request under advisement.
10 comments
-
Paul Robert Wittig
commented
This is not acceptable. Give us a static link.
-
Atif Al-Amir
commented
try this:
curl -sS https://www.microsoft.com/en-us/download/confirmation.aspx?id=56519 | egrep -o 'https://download.*?\.json'; | uniq
returns link you can use with wget -
t4c
commented
Agreed. It is sad this is not a static page. The JSON file is also not in the same structure as other CDN providers which required a completely different function to process it as well. More sad. LESS SAD - The function below works for downloading the JSON file automatically though.
(NOTE : The source file url is obtained from copying link location from download button, it is as static as the link from admin as well).function DownloadFileFromInternet {
param (
[string]$SourceFileURL = ([string]("")),
[string]$SourceFileDownloadMethod = ([string]("")),
[string]$DestinationFilePath = ([string]("")),
[string]$DestinationFileName = ([string](""))
)if ($SourceFileDownloadMethod -match "STANDARD") {
[string]$SourceFileDownloadURLstr = $SourceFileURL
}
if ($SourceFileDownloadMethod -match "MICROSOFT") {$WCDnString = New-Object System.Net.WebClient
$SourceFileURLHTMLStr = $webClient.DownloadString($SourceFileURL)[int]$RelevantStringStart = (($SourceFileURLHTMLStr.LastIndexOf('downloadData={')) + 14)
[int]$RelevantStringEnd = ($SourceFileURLHTMLStr.LastIndexOf('id:56519'))
[int]$RelevantStringLength = $RelevantStringEnd - $RelevantStringStart
[string]$SourceFileDownloadURLstr = $SourceFileURLHTMLStr.Substring($RelevantStringStart,$RelevantStringLength)[int]$RelevantStringStart = ($SourceFileDownloadURLstr.LastIndexOf('https://'))
[int]$RelevantStringEnd = ($SourceFileDownloadURLstr.LastIndexOf('.json') + 5)
[int]$RelevantStringLength = $RelevantStringEnd - $RelevantStringStart
[string]$SourceFileDownloadURLstr = $SourceFileDownloadURLstr.Substring($RelevantStringStart,$RelevantStringLength)
$SourceFileDownloadURLstr = $SourceFileDownloadURLstr}
[string]$DestinationFileFullPath = ([string](($DestinationFilePath) + ("\") + ($DestinationFileName)))
$WCDnFile = New-Object System.Net.WebClient
$RetWCDnFile = $WCDnFile.DownloadFile($SourceFileDownloadURLstr,$DestinationFileFullPath)}
-
Andrew Br
commented
This should be an API like AWS and GCP. Why is this still broken?
-
Jason Robinson
commented
2.5 Years later, still a problem. Why are you actively trying to steal our time? A static link is easier for everybody to work with than an ASPX page.
-
Oliver
commented
Still the same issue after 3 years.. AWS is much more advanced at this point..
-
Paul Gaynor
commented
I am also looking for a programmatic way to pull this data.
It would be very useful for us to be able to get this data through a public URL.
It would also be helpful if we could get this data from an azure cli / sdk request.
Thanks!
-
Anonymous
commented
Except that this method requires you to click the download button to actually get the link to the list. Can you not just publish the latest list to a static URL so we know exactly where to get it without having to script passing through this hurdle?
-
Mohammed
commented
Checking the link every week for updates is a manual task, this needs to be automated. O365 IP ranges have the possibility of alerting the customers via RSS Feeds. Atleast this can be helpful and a quick one.
-
Anonymous
commented
Looking for the same. Need an easy way to automate so we can update things automatically when the IP address ranges change.