From chris at thegreenwebfoundation.org Mon May 16 17:29:52 2022 From: chris at thegreenwebfoundation.org (Chris Adams) Date: Mon, 16 May 2022 17:29:52 +0200 Subject: [SCION] Geocoding SCION info - how would I do this for a demo? Message-ID: <1190A6A7-E133-4BAC-886F-3E4DBFCAE615@thegreenwebfoundation.org> Hi folks, I?m doing a talk at RIPE 84 tomorrow about sustainability and IT (specifically networks), and I have a question about SCION?s AS system, this article here, and the state of geolocation to make this idea possible. https://www.weforum.org/agenda/2021/03/internet-carbon-emissions-data-path-scion/ Some background I?ve recently been doing work to annotate every public IP that can be looked up with common geocoders with annual carbon intensity information. This was initially to make it easier for providers of hosting services to easily disclose carbon emissions information based on their location, and to use this information for scheduling workloads. I?ve been discussing this with the folks Hashicorp and specifically implementing it in Nomad, an alternative workload scheduling tool you might use in place of Kubernetes. This is now an experimental "carbon aware" branch of Nomad with an updated scheduler that does this, by using a carbon scoring algorithm for deciding where and when to run jobs: https://github.com/hashicorp/nomad/blob/d8b3a61d9ab85d3102e6c666af9f11c2a4a04ae5/CARBON.md This PR I merged in today exposes an API endpoint to get carbon intensity for any publicly available IP address, based on it?s likely location (although the data is only as good as the database I?m currently using from Maxmind, so all the usual caveats apply) https://github.com/thegreenwebfoundation/admin-portal/pull/248 You can see some docs at the link below, and a way to try out the API with various IP addresses yourself (warning - I just merged it today, and it may be buggy!) https://api.thegreenwebfoundation.org/api-docs/ I?d like to move towards have monthly carbon intensity figures, at a national level, by the end of the year - something that folks who run hosted services would be able to disclose information about how they are accounting for the rest of the emissions, probably using some new tools and standards like Granular Certificates (linked below) - these provide hourly information about the carbon intensity of generation from various sources. https://www.energytag.org/wp-content/uploads/2021/05/EnergyTag-and-granular-energy-certificates.pdf The carbon intensity data I?m using is open and freely available, and the geolocation data is not super duper precise, but it is free. Doing the same for routing with SCION However, these are all ideas for the regular old internet, and I don?t know what the latest is since reading that piece in the WEF last year. I?d like to figure see if it?s possible to use any of what I?ve learned on SCION - are there any demos in the public domain, or examples to refer to, if I wanted to tell people about SCION?s routing abilities in the context of ranking routes based on likely carbon intensity? Thanks Chris Chris Adams Co-director w: thegreenwebfoundation.org e: chris at thegreenwebfoundation.org t: @mrchrisadams The Green Web Foundation Van 't Hoffstraat 1 6706 KD Wageningen, The Netherlands From david.hausheer at gmail.com Tue May 17 10:19:27 2022 From: david.hausheer at gmail.com (David Hausheer) Date: Tue, 17 May 2022 10:19:27 +0200 Subject: [SCION] Geocoding SCION info - how would I do this for a demo? In-Reply-To: <1190A6A7-E133-4BAC-886F-3E4DBFCAE615@thegreenwebfoundation.org> References: <1190A6A7-E133-4BAC-886F-3E4DBFCAE615@thegreenwebfoundation.org> Message-ID: <13fd008e-64c2-c6f2-1e0e-f05519026972@gmail.com> Hi Chris, Thanks for sharing the API to retrieve carbon intensity figures. We'll be glad to take a look at it! > I?d like to figure see if it?s possible to use any of what I?ve learned on SCION - are there any demos in the public domain, or examples to refer to, if I wanted to tell people about SCION?s routing abilities in the context of ranking routes based on likely carbon intensity? Our PANAPI approach [1,2] on top of SCION facilitates to rank paths based on metrics chosen by the user/application. We also have an example that uses carbon footprint as a metric. We've recently demonstrated our basic path selection feature in the scope of NGI Pointer. There is also a small demo video available about this. [1] https://github.com/netsys-lab/panapi [2] https://www.ngi.eu/funded_solution/ngi-pointer-project-33/ Best regards David On 16/05/2022 17:29, Chris Adams wrote: > Hi folks, > > I?m doing a talk at RIPE 84 tomorrow about sustainability and IT (specifically networks), and I have a question about SCION?s AS system, this article here, and the state of geolocation to make this idea possible. > > https://www.weforum.org/agenda/2021/03/internet-carbon-emissions-data-path-scion/ > > Some background > > I?ve recently been doing work to annotate every public IP that can be looked up with common geocoders with annual carbon intensity information. > > This was initially to make it easier for providers of hosting services to easily disclose carbon emissions information based on their location, and to use this information for scheduling workloads. > > I?ve been discussing this with the folks Hashicorp and specifically implementing it in Nomad, an alternative workload scheduling tool you might use in place of Kubernetes. > > This is now an experimental "carbon aware" branch of Nomad with an updated scheduler that does this, by using a carbon scoring algorithm for deciding where and when to run jobs: > https://github.com/hashicorp/nomad/blob/d8b3a61d9ab85d3102e6c666af9f11c2a4a04ae5/CARBON.md > > This PR I merged in today exposes an API endpoint to get carbon intensity for any publicly available IP address, based on it?s likely location (although the data is only as good as the database I?m currently using from Maxmind, so all the usual caveats apply) > https://github.com/thegreenwebfoundation/admin-portal/pull/248 > > You can see some docs at the link below, and a way to try out the API with various IP addresses yourself (warning - I just merged it today, and it may be buggy!) > https://api.thegreenwebfoundation.org/api-docs/ > > I?d like to move towards have monthly carbon intensity figures, at a national level, by the end of the year - something that folks who run hosted services would be able to disclose information about how they are accounting for the rest of the emissions, probably using some new tools and standards like Granular Certificates (linked below) - these provide hourly information about the carbon intensity of generation from various sources. > > https://www.energytag.org/wp-content/uploads/2021/05/EnergyTag-and-granular-energy-certificates.pdf > > The carbon intensity data I?m using is open and freely available, and the geolocation data is not super duper precise, but it is free. > > Doing the same for routing with SCION > > However, these are all ideas for the regular old internet, and I don?t know what the latest is since reading that piece in the WEF last year. > > I?d like to figure see if it?s possible to use any of what I?ve learned on SCION - are there any demos in the public domain, or examples to refer to, if I wanted to tell people about SCION?s routing abilities in the context of ranking routes based on likely carbon intensity? > > Thanks > > Chris > > > > > > > Chris Adams > > Co-director > > w: thegreenwebfoundation.org > e: chris at thegreenwebfoundation.org > t: @mrchrisadams > > The Green Web Foundation > Van 't Hoffstraat 1 > 6706 KD Wageningen, The Netherlands > > > _______________________________________________ > SCION mailing list > SCION at lists.inf.ethz.ch > https://lists.inf.ethz.ch/mailman/listinfo/scion From chris at thegreenwebfoundation.org Tue May 17 10:41:13 2022 From: chris at thegreenwebfoundation.org (Chris Adams) Date: Tue, 17 May 2022 10:41:13 +0200 Subject: [SCION] Geocoding SCION info - how would I do this for a demo? In-Reply-To: References: <1190A6A7-E133-4BAC-886F-3E4DBFCAE615@thegreenwebfoundation.org> Message-ID: <4A8C7F32-03CF-45B6-99C3-7F6C621EC6C1@thegreenwebfoundation.org> Hi Adrian! I?m doing a plenary session today at 11 am CET. https://ripe84.ripe.net/programme/meeting-plan/plenary/ I?ve added a slide from that deck, and a link back to the newsletter. Chris Adams Co-director w: thegreenwebfoundation.org e: chris at thegreenwebfoundation.org t: @mrchrisadams The Green Web Foundation Van 't Hoffstraat 1 6706 KD Wageningen, The Netherlands > On 16. May 2022, at 22:17, Adrian Perrig wrote: > > Hi Chris > > Nice to hear from you, these are very interesting developments! > > Attached are a few slides, an example you may have seen in an earlier > presentation (I think we were together on a panel) to motivate green > routing, and an early result from our simulations of green routing using > SCION. Slides 2 and 3 show two different representations of the same > data. The results are very exciting, as the slide describes. We > simulated the Internet topology, and assigned CO2 emissions based on > routers' location and the local power mix. > > What's exciting is that your datacenter-based information and our > network-path based information are very complementary, such that if an > application-based API were established, then this could be used to > optimize both the carbon footprint of the network path as well as of > the computation. > > Please let us know if you need any other information. > > Which RIPE session are you presenting in? > > With kind regards > Adrian > > > On Mon, May 16, 2022 at 5:31 PM Chris Adams > wrote: > Hi folks, > > I?m doing a talk at RIPE 84 tomorrow about sustainability and IT (specifically networks), and I have a question about SCION?s AS system, this article here, and the state of geolocation to make this idea possible. > > https://www.weforum.org/agenda/2021/03/internet-carbon-emissions-data-path-scion/ > > > Some background > > I?ve recently been doing work to annotate every public IP that can be looked up with common geocoders with annual carbon intensity information. > > This was initially to make it easier for providers of hosting services to easily disclose carbon emissions information based on their location, and to use this information for scheduling workloads. > > I?ve been discussing this with the folks Hashicorp and specifically implementing it in Nomad, an alternative workload scheduling tool you might use in place of Kubernetes. > > This is now an experimental "carbon aware" branch of Nomad with an updated scheduler that does this, by using a carbon scoring algorithm for deciding where and when to run jobs: > https://github.com/hashicorp/nomad/blob/d8b3a61d9ab85d3102e6c666af9f11c2a4a04ae5/CARBON.md > > > This PR I merged in today exposes an API endpoint to get carbon intensity for any publicly available IP address, based on it?s likely location (although the data is only as good as the database I?m currently using from Maxmind, so all the usual caveats apply) > https://github.com/thegreenwebfoundation/admin-portal/pull/248 > > > You can see some docs at the link below, and a way to try out the API with various IP addresses yourself (warning - I just merged it today, and it may be buggy!) > https://api.thegreenwebfoundation.org/api-docs/ > > > I?d like to move towards have monthly carbon intensity figures, at a national level, by the end of the year - something that folks who run hosted services would be able to disclose information about how they are accounting for the rest of the emissions, probably using some new tools and standards like Granular Certificates (linked below) - these provide hourly information about the carbon intensity of generation from various sources. > > https://www.energytag.org/wp-content/uploads/2021/05/EnergyTag-and-granular-energy-certificates.pdf > > > The carbon intensity data I?m using is open and freely available, and the geolocation data is not super duper precise, but it is free. > > Doing the same for routing with SCION > > However, these are all ideas for the regular old internet, and I don?t know what the latest is since reading that piece in the WEF last year. > > I?d like to figure see if it?s possible to use any of what I?ve learned on SCION - are there any demos in the public domain, or examples to refer to, if I wanted to tell people about SCION?s routing abilities in the context of ranking routes based on likely carbon intensity? > > Thanks > > Chris > > > > > > > Chris Adams > > Co-director > > w: thegreenwebfoundation.org > e: chris at thegreenwebfoundation.org > t: @mrchrisadams > > The Green Web Foundation > Van 't Hoffstraat 1 > 6706 KD Wageningen, The Netherlands > > > _______________________________________________ > SCION mailing list > SCION at lists.inf.ethz.ch > https://lists.inf.ethz.ch/mailman/listinfo/scion >