BGP data in real time?
Does anyone know of a good way for monitoring BGP route data in near real-time? There are several public BGPPlay sites out there but the data seems delayed? That being said, one challenge I'm having with the sites is the time stamps don't say which timezone they are in. I assume it is UTC but if that is the case then the data is at least a couple hours old on any of the sites I've found. John
Generally correct. The data is VERY resource-intensive to process and AFAIK that delay literally just reflects the processing time. If you want real-time, you generally need your own BGP router(a) so you can suck data from it/them. You can also pay obscene amounts of money to Oracle (who now owns a few network intelligence companies including Thousandeyes among others) to get closer to real time, depending on what data you're after. Email Theo and/or me with more details if you don't want to share them publicly. -Adam ________________________________ From: Roundtable <roundtable-bounces@muug.ca> on behalf of John Lange <john@johnlange.ca> Sent: Friday, July 8, 2022, 15:45 To: Roundtable, MUUG <Roundtable@muug.ca> Subject: [RndTbl] BGP data in real time? Does anyone know of a good way for monitoring BGP route data in near real-time? There are several public BGPPlay sites out there but the data seems delayed? That being said, one challenge I'm having with the sites is the time stamps don't say which timezone they are in. I assume it is UTC but if that is the case then the data is at least a couple hours old on any of the sites I've found. John
Oh, another way to get – not the BGP data, but other data that can act as a proxy – is to run RIPE Atlas queries. Among the queries you can run are “traceroute” queries, which can give some of the same resulting insights as having the raw BGP routes. -Adam From: Roundtable <roundtable-bounces@muug.ca> On Behalf Of Adam Thompson Sent: Friday, July 8, 2022 3:54 PM To: Continuation of Round Table discussion <Roundtable@muug.ca> Subject: Re: [RndTbl] BGP data in real time? Generally correct. The data is VERY resource-intensive to process and AFAIK that delay literally just reflects the processing time. If you want real-time, you generally need your own BGP router(a) so you can suck data from it/them. You can also pay obscene amounts of money to Oracle (who now owns a few network intelligence companies including Thousandeyes among others) to get closer to real time, depending on what data you're after. Email Theo and/or me with more details if you don't want to share them publicly. -Adam ________________________________ From: Roundtable <roundtable-bounces@muug.ca<mailto:roundtable-bounces@muug.ca>> on behalf of John Lange <john@johnlange.ca<mailto:john@johnlange.ca>> Sent: Friday, July 8, 2022, 15:45 To: Roundtable, MUUG <Roundtable@muug.ca<mailto:Roundtable@muug.ca>> Subject: [RndTbl] BGP data in real time? Does anyone know of a good way for monitoring BGP route data in near real-time? There are several public BGPPlay sites out there but the data seems delayed? That being said, one challenge I'm having with the sites is the time stamps don't say which timezone they are in. I assume it is UTC but if that is the case then the data is at least a couple hours old on any of the sites I've found. John
Just trying to track the Rogers AS812 route announcements to get a sense when they may be coming back up. As of 20:00 UTC (which I think is 3pm Central) they had zero routes. John On Fri, Jul 8, 2022 at 4:02 PM Adam Thompson <athompso@athompso.net> wrote:
Oh, another way to get – not the BGP data, but other data that can act as a proxy – is to run RIPE Atlas queries. Among the queries you can run are “traceroute” queries, which can give some of the same resulting insights as having the raw BGP routes.
-Adam
*From:* Roundtable <roundtable-bounces@muug.ca> *On Behalf Of *Adam Thompson *Sent:* Friday, July 8, 2022 3:54 PM *To:* Continuation of Round Table discussion <Roundtable@muug.ca> *Subject:* Re: [RndTbl] BGP data in real time?
Generally correct. The data is VERY resource-intensive to process and AFAIK that delay literally just reflects the processing time.
If you want real-time, you generally need your own BGP router(a) so you can suck data from it/them.
You can also pay obscene amounts of money to Oracle (who now owns a few network intelligence companies including Thousandeyes among others) to get closer to real time, depending on what data you're after.
Email Theo and/or me with more details if you don't want to share them publicly.
-Adam
------------------------------
*From:* Roundtable <roundtable-bounces@muug.ca> on behalf of John Lange < john@johnlange.ca> *Sent:* Friday, July 8, 2022, 15:45 *To:* Roundtable, MUUG <Roundtable@muug.ca> *Subject:* [RndTbl] BGP data in real time?
Does anyone know of a good way for monitoring BGP route data in near real-time? There are several public BGPPlay sites out there but the data seems delayed?
That being said, one challenge I'm having with the sites is the time stamps don't say which timezone they are in. I assume it is UTC but if that is the case then the data is at least a couple hours old on any of the sites I've found.
John
_______________________________________________ Roundtable mailing list Roundtable@muug.ca https://muug.ca/mailman/listinfo/roundtable
-- John Lange
Yes, 20:00 UTC is 14:00 CST is 15:00 CDT (3 pm). Hartmut W Sager - Tel +1-204-339-8331 (Fido, down), +1-204-515-1701 (my VoIP, up). On Fri, 8 Jul 2022 at 16:16, John Lange <john@johnlange.ca> wrote:
Just trying to track the Rogers AS812 route announcements to get a sense when they may be coming back up. As of 20:00 UTC (which I think is 3pm Central) they had zero routes.
John
Pretty sure you won't see it there first, but... Cloudflare and Noction and Kentik are all already monitoring it. Don't know if they have anything more real time than blog posts, though. The scope of the outage guarantees it's not just an eBGP failure - e911 operations should be unaffected by anything short of the complete collapse the the Telco core. My money is on an internal naming service (not DNS, more like JNDI or the SS7 service naming service whose name I can't remember) and a botched upgrade, plus some previously-unknown circular dependencies preventing a cold restart. -Adam Get Outlook for Android<https://aka.ms/AAb9ysg> ________________________________ From: Roundtable <roundtable-bounces@muug.ca> on behalf of John Lange <john@johnlange.ca> Sent: Friday, July 8, 2022 4:15:39 PM To: Continuation of Round Table discussion <roundtable@muug.ca> Subject: Re: [RndTbl] BGP data in real time? Just trying to track the Rogers AS812 route announcements to get a sense when they may be coming back up. As of 20:00 UTC (which I think is 3pm Central) they had zero routes. John On Fri, Jul 8, 2022 at 4:02 PM Adam Thompson <athompso@athompso.net<mailto:athompso@athompso.net>> wrote: Oh, another way to get – not the BGP data, but other data that can act as a proxy – is to run RIPE Atlas queries. Among the queries you can run are “traceroute” queries, which can give some of the same resulting insights as having the raw BGP routes. -Adam From: Roundtable <roundtable-bounces@muug.ca<mailto:roundtable-bounces@muug.ca>> On Behalf Of Adam Thompson Sent: Friday, July 8, 2022 3:54 PM To: Continuation of Round Table discussion <Roundtable@muug.ca<mailto:Roundtable@muug.ca>> Subject: Re: [RndTbl] BGP data in real time? Generally correct. The data is VERY resource-intensive to process and AFAIK that delay literally just reflects the processing time. If you want real-time, you generally need your own BGP router(a) so you can suck data from it/them. You can also pay obscene amounts of money to Oracle (who now owns a few network intelligence companies including Thousandeyes among others) to get closer to real time, depending on what data you're after. Email Theo and/or me with more details if you don't want to share them publicly. -Adam ________________________________ From: Roundtable <roundtable-bounces@muug.ca<mailto:roundtable-bounces@muug.ca>> on behalf of John Lange <john@johnlange.ca<mailto:john@johnlange.ca>> Sent: Friday, July 8, 2022, 15:45 To: Roundtable, MUUG <Roundtable@muug.ca<mailto:Roundtable@muug.ca>> Subject: [RndTbl] BGP data in real time? Does anyone know of a good way for monitoring BGP route data in near real-time? There are several public BGPPlay sites out there but the data seems delayed? That being said, one challenge I'm having with the sites is the time stamps don't say which timezone they are in. I assume it is UTC but if that is the case then the data is at least a couple hours old on any of the sites I've found. John _______________________________________________ Roundtable mailing list Roundtable@muug.ca<mailto:Roundtable@muug.ca> https://muug.ca/mailman/listinfo/roundtable -- John Lange
https://www.youtube.com/watch?v=3MN1ab6kgGc relates. On Fri, Jul 8, 2022 at 4:31 PM Adam Thompson <athompso@athompso.net> wrote:
Pretty sure you won't see it there first, but... Cloudflare and Noction and Kentik are all already monitoring it. Don't know if they have anything more real time than blog posts, though.
The scope of the outage guarantees it's not just an eBGP failure - e911 operations should be unaffected by anything short of the complete collapse the the Telco core.
My money is on an internal naming service (not DNS, more like JNDI or the SS7 service naming service whose name I can't remember) and a botched upgrade, plus some previously-unknown circular dependencies preventing a cold restart.
-Adam Get Outlook for Android <https://aka.ms/AAb9ysg> ------------------------------ *From:* Roundtable <roundtable-bounces@muug.ca> on behalf of John Lange < john@johnlange.ca> *Sent:* Friday, July 8, 2022 4:15:39 PM *To:* Continuation of Round Table discussion <roundtable@muug.ca> *Subject:* Re: [RndTbl] BGP data in real time?
Just trying to track the Rogers AS812 route announcements to get a sense when they may be coming back up. As of 20:00 UTC (which I think is 3pm Central) they had zero routes.
John
On Fri, Jul 8, 2022 at 4:02 PM Adam Thompson <athompso@athompso.net> wrote:
Oh, another way to get – not the BGP data, but other data that can act as a proxy – is to run RIPE Atlas queries. Among the queries you can run are “traceroute” queries, which can give some of the same resulting insights as having the raw BGP routes.
-Adam
*From:* Roundtable <roundtable-bounces@muug.ca> *On Behalf Of *Adam Thompson *Sent:* Friday, July 8, 2022 3:54 PM *To:* Continuation of Round Table discussion <Roundtable@muug.ca> *Subject:* Re: [RndTbl] BGP data in real time?
Generally correct. The data is VERY resource-intensive to process and AFAIK that delay literally just reflects the processing time.
If you want real-time, you generally need your own BGP router(a) so you can suck data from it/them.
You can also pay obscene amounts of money to Oracle (who now owns a few network intelligence companies including Thousandeyes among others) to get closer to real time, depending on what data you're after.
Email Theo and/or me with more details if you don't want to share them publicly.
-Adam
------------------------------
*From:* Roundtable <roundtable-bounces@muug.ca> on behalf of John Lange < john@johnlange.ca> *Sent:* Friday, July 8, 2022, 15:45 *To:* Roundtable, MUUG <Roundtable@muug.ca> *Subject:* [RndTbl] BGP data in real time?
Does anyone know of a good way for monitoring BGP route data in near real-time? There are several public BGPPlay sites out there but the data seems delayed?
That being said, one challenge I'm having with the sites is the time stamps don't say which timezone they are in. I assume it is UTC but if that is the case then the data is at least a couple hours old on any of the sites I've found.
John
_______________________________________________ Roundtable mailing list Roundtable@muug.ca https://muug.ca/mailman/listinfo/roundtable
-- John Lange
_______________________________________________ Roundtable mailing list Roundtable@muug.ca https://muug.ca/mailman/listinfo/roundtable
Will we ever get the full news? But good anticipation Adam Rogers service restored after Canada-wide outage, blames router malfunction “We now believe we’ve narrowed the cause to a network system failure following a maintenance update in our core network, which caused some of our routers to malfunction early Friday morning,” Rogers’ Chief Executive Officer Tony Staffieri said in a statement. https://www.rappler.com/technology/rogers-communications-service-restored-ca... On 2022-07-08 14:27, Adam Thompson wrote:
Pretty sure you won't see it there first, but... Cloudflare and Noction and Kentik are all already monitoring it. Don't know if they have anything more real time than blog posts, though.
The scope of the outage guarantees it's not just an eBGP failure - e911 operations should be unaffected by anything short of the complete collapse the the Telco core.
My money is on an internal naming service (not DNS, more like JNDI or the SS7 service naming service whose name I can't remember) and a botched upgrade, plus some previously-unknown circular dependencies preventing a cold restart.
-Adam Get Outlook for Android [1] -------------------------
From: Roundtable <roundtable-bounces@muug.ca> on behalf of John Lange <john@johnlange.ca> Sent: Friday, July 8, 2022 4:15:39 PM To: Continuation of Round Table discussion <roundtable@muug.ca> Subject: Re: [RndTbl] BGP data in real time?
Just trying to track the Rogers AS812 route announcements to get a sense when they may be coming back up. As of 20:00 UTC (which I think is 3pm Central) they had zero routes.
John
On Fri, Jul 8, 2022 at 4:02 PM Adam Thompson <athompso@athompso.net> wrote:
Oh, another way to get – not the BGP data, but other data that can act as a proxy – is to run RIPE Atlas queries. Among the queries you can run are “traceroute” queries, which can give some of the same resulting insights as having the raw BGP routes.
-Adam
From: Roundtable <roundtable-bounces@muug.ca> On Behalf Of Adam Thompson Sent: Friday, July 8, 2022 3:54 PM To: Continuation of Round Table discussion <Roundtable@muug.ca> Subject: Re: [RndTbl] BGP data in real time?
Generally correct. The data is VERY resource-intensive to process and AFAIK that delay literally just reflects the processing time.
If you want real-time, you generally need your own BGP router(a) so you can suck data from it/them.
You can also pay obscene amounts of money to Oracle (who now owns a few network intelligence companies including Thousandeyes among others) to get closer to real time, depending on what data you're after.
Email Theo and/or me with more details if you don't want to share them publicly.
-Adam
-------------------------
From: Roundtable <roundtable-bounces@muug.ca> on behalf of John Lange <john@johnlange.ca> Sent: Friday, July 8, 2022, 15:45 To: Roundtable, MUUG <Roundtable@muug.ca> Subject: [RndTbl] BGP data in real time?
Does anyone know of a good way for monitoring BGP route data in near real-time? There are several public BGPPlay sites out there but the data seems delayed?
That being said, one challenge I'm having with the sites is the time stamps don't say which timezone they are in. I assume it is UTC but if that is the case then the data is at least a couple hours old on any of the sites I've found.
John
_______________________________________________ Roundtable mailing list Roundtable@muug.ca https://muug.ca/mailman/listinfo/roundtable
--
John Lange
Links: ------ [1] https://aka.ms/AAb9ysg _______________________________________________ Roundtable mailing list Roundtable@muug.ca https://muug.ca/mailman/listinfo/roundtable
participants (5)
-
Adam Thompson -
eh＠eduardhiebert.com -
Hartmut W Sager -
John Lange -
Robert Keizer