Wiki source code of 2nd Workshop on Sustainability
Last modified by Angela Warkentin on 2025/07/16 15:13
Hide last authors
| author | version | line-number | content |
|---|---|---|---|
 |
10.1 | 1 | == **2nd Workshop on Sustainability in the Digital Transformation of Basic Research on Universe & Matter (2025)** == |
| |
4.1 | 2 | |
| |
12.1 | 3 | |
| |
13.1 | 4 | ---- |
| |
12.1 | 5 | |
| 6 | |||
| |
10.1 | 7 | === **What happened so far: ** === |
| |
4.1 | 8 | |
| |
5.1 | 9 | * 2023: In-person Workshop:[[ https:~~/~~/indico.desy.de/event/37480/>>url:https://indico.desy.de/event/37480/]] |
| 10 | * 2024: Follow up paper and online meetings | ||
| |
11.1 | 11 | ** Publication:[[ https:~~/~~/arxiv.org/abs/2311.01169>>url:https://arxiv.org/abs/2311.01169]] Last sustainability workshop paper: [[https:~~/~~/doi.org/10.1140/epjs/s11734-024-01436-4>>url:https://doi.org/10.1140/epjs/s11734-024-01436-4]] |
| |
5.1 | 12 | ** Online Discussion:[[ https:~~/~~/indico.desy.de/event/44490/>>url:https://indico.desy.de/event/44490/]] |
| 13 | ** Online Discussion:[[ https:~~/~~/indico.desy.de/event/45927/>>url:https://indico.desy.de/event/45927/]] | ||
| 14 | * **2025: In-person Workshop: [[https:~~/~~/indico.desy.de/event/47133/>>url:https://indico.desy.de/event/47133/]] ** | ||
| 15 | ** **28 July - 1 August 2024** | ||
| 16 | ** **(Erholungsgesellschaft) Aachen** | ||
| 17 | |||
| |
10.1 | 18 | === **Meeting documentation: ** === |
| |
5.1 | 19 | |
| 20 | **First Meeting with the Program Committee 19.02.2025** | ||
| 21 | Participation: Jan Bürger, Markus Demleitner, Günter Duckeck, Martin Erdmann, Benjamin Fischer, Martin Gasthuber, Thomas Kuhr, Judith Reindl, Markus Schumacher, Judith Steinfeld, Dwayne Spiteri, Achim Streit, Angela Warkentin, Sebastian Wozniewski | ||
| 22 | |||
| 23 | * [[Brainstorming document>>https://docs.google.com/document/d/1S7DN9xc_zbogT9byt44xSCm0hpBDPFNy5b20U5a2HU8/edit?tab=t.0]] | ||
| 24 | * [[Slides>>attach:Program Planning Meeting, Feb 19.pdf]] | ||
| |
7.1 | 25 | * [[attach:preparation-slides.pdf||target="_blank"]] |
| |
5.1 | 26 | |
| |
6.1 | 27 | |
| 28 | |||
| 29 | **Second Meeting with the Program Committee 11.03.2025** | ||
| 30 | |||
| |
7.1 | 31 | * Tuesday, March 11 from 4 - 5:30 pm: [[https:~~/~~/rwth.zoom-x.de/j/65088391540>>https://rwth.zoom-x.de/j/65088391540]] |
| |
22.1 | 32 | * Discussion & Results: [[attach:2nd Program Planning March 11.pdf||target="_blank"]] |
| 33 | * Participation: Jan Bürger, Markus Demleitner, Martin Erdmann, Benjamin Fischer, Martin Gasthuber, Simran Guardasani, Thomas Kuhr, Markus Schumacher, Dwayne Spiteri, Angela Warkentin, Sebastian Wozniewski | ||
| |
24.1 | 34 | * Follow-up note from Dwayne: There was one point I think is missing from the slides for your discussions with the other organisers, if we are going to try and create a single timetable with these semi-dissimilar topics, we do need a bridge session to add some continuity, something about the ethics of sustainability. It doesn't have to be too long, but I think it needs to be there if the conference is to have a sense of coherence. |
| |
6.1 | 35 | |
| |
8.1 | 36 | |
| 37 | |||
| |
24.2 | 38 | **Third Meeting with the Program Committee 10.04.2025** |
| 39 | |||
| |
25.1 | 40 | * Thursday, April 10 from 4 - 5:30 pm |
| |
27.1 | 41 | * Discussion & Results: [[attach:3rd Program Planning April 10.pdf||target="_blank"]] |
| |
25.1 | 42 | * Participation: Jan Bürger, Markus Demleitner, Günter Duckeck, Martin Erdmann, Benjamin Fischer, Martin Gasthuber, Simran Guardasani, Thomas Kuhr, Pardis Niknejadi, Kilian Schwarz, Dwayne Spiteri, Angela Warkentin |
| |
24.2 | 43 | |
| 44 | |||
| 45 | |||
| |
13.1 | 46 | ---- |
| |
12.1 | 47 | |
| 48 | |||
| |
23.1 | 49 | == **Discussion Basis for Second Meeting with the Program Committee 11.03.2025** == |
| |
10.1 | 50 | |
| |
23.1 | 51 | **Results: **[[attach:2nd Program Planning March 11.pdf||target="_blank"]] |
| 52 | |||
| |
14.1 | 53 | === **1. Regarding Goals ** === |
| |
10.1 | 54 | |
| 55 | |||
| |
9.1 | 56 | |(% style="width:268px" %)((( |
| 57 | **Goals** | ||
| 58 | |||
| 59 | **(Up to discussion on March, 11) ** | ||
| 60 | )))|(% style="width:1019px" %)((( | ||
| 61 | |||
| 62 | )))|((( | ||
| |
10.1 | 63 | Author / Contact (optional) |
| |
9.1 | 64 | ))) |
| |
16.1 | 65 | |(% colspan="1" rowspan="2" style="width:268px" %)**Definition**|(% style="width:1019px" %)What exactly is meant by “sustainability”|Achim S., Judith R. |
| 66 | |(% style="width:1019px" %) | | ||
| 67 | |(% colspan="1" rowspan="2" style="width:268px" %)**Track Progress / Review**|(% style="width:1019px" %)What is the concrete progress since the last workshop, what worked, what not.|Thomas K, Judith R. | ||
| 68 | |(% style="width:1019px" %) | | ||
| 69 | |(% colspan="1" rowspan="4" style="width:268px" %)((( | ||
| 70 | **Ideas / Ansätze** | ||
| |
9.1 | 71 | )))|(% style="width:1019px" %)Based on input from referees I think one topic is whether we should collect data to effectively represent progress| |
| |
16.1 | 72 | |(% style="width:1019px" %)What new ansatzes (//approaches//) exist, what should we try|Achim S. |
| 73 | |(% style="width:1019px" %) | | ||
| 74 | |(% style="width:1019px" %) | | ||
| 75 | |(% colspan="1" rowspan="5" style="width:268px" %)**Concrete Recommendation for Action & Outlook **|(% style="width:1019px" %)((( | ||
| |
9.1 | 76 | Konkrete Empfehlungen ans BMBF bzw. Projekte als einige white papers. |
| 77 | |||
| 78 | (//Concrete recommendations to the BMBF and projects in the form of white papers//) | ||
| 79 | )))| | ||
| 80 | |(% style="width:1019px" %)((( | ||
| |
16.1 | 81 | Formation of focus groups for the implementation of identified guidelines from multiple projects, beyond the workshop (e.g. Connect Workshop 2024) |
| |
9.1 | 82 | )))| |
| 83 | |(% style="width:1019px" %)((( | ||
| 84 | Prüfsteine für einen dritten Workshop, der die Umsetzung der Fokusgruppen überprüfen kann. | ||
| 85 | |||
| 86 | //Criteria for a third workshop that can assess the implementation of the focus groups.// | ||
| 87 | )))| | ||
| |
16.1 | 88 | |(% style="width:1019px" %)A paper detailing how to combat the practicalities of tackling sustainability issues (in Germany)| |
| 89 | |(% style="width:1019px" %) | | ||
| |
9.1 | 90 | |
| 91 | |||
| 92 | |||
| |
16.1 | 93 | ==== **Goals: ** ==== |
| |
9.1 | 94 | |
| |
16.1 | 95 | * Focus is on implementation: Last workshop was impulse, this should enable implementation by developing concrete action points. |
| |
9.1 | 96 | * Do we need a paper? How can the results be optimally prepared? |
| 97 | * At the end, concrete measures should emerge and be recorded (e.g. white paper, without publication, but with the aim of disseminating the measures widely) | ||
| |
16.1 | 98 | * Concrete assignments: To present at DPG, concrete “tasks” with responsible persons (to be reported, e.g. to Overview Board or next year in the workshop) |
| |
9.1 | 99 | |
| 100 | |||
| 101 | |||
| |
15.1 | 102 | |
| 103 | |||
| |
14.1 | 104 | === **2. Regarding Contents ** === |
| |
10.1 | 105 | |
| 106 | |||
| |
20.1 | 107 | **Possible Focus: “Framework conditions for future research in ErUM in view of ultra-fast AI developments and the urgent need for sustainability in the area of digital transformation”** |
| |
18.1 | 108 | |
| |
20.1 | 109 | * **Title of the Workshop: Currrently "**[[2nd Workshop on Sustainability in the Digital Transformation of Basic Research on Universe & Matter>>url:https://indico.desy.de/event/47133/]]" |
| 110 | * Sustainability: The topic of sustainability has been initiated by the first workshop/paper; we can already hear about ongoing research projects and draw further consequences for progress. | ||
| 111 | * Ethics: The topic of ethics deals with AI developments and their significance for ErUM researchers. The aim here is to compile concrete AI developments and to identify probable development possibilities. | ||
| 112 | ** How will it be possible to realize predominantly human-performed research activities with the support of AI tools in the future? | ||
| 113 | ** Can we formulate a range for this? | ||
| |
18.1 | 114 | |
| |
20.1 | 115 | |
| 116 | |||
| |
8.1 | 117 | |((( |
| |
9.1 | 118 | **Topics ** |
| |
8.1 | 119 | |
| 120 | **(Up to discussion on March, 11) ** | ||
| 121 | )))|(% style="width:1011px" %)((( | ||
| 122 | **What do we want to cover in terms of content? ** | ||
| 123 | |||
| 124 | (//**Subgroups 2023:** Footprint, Dynamic Energy Supply, Hardware Lifetime, Hardware & Algorithms, Smart Data, Cultural Change, Autonomization, Inquiries & Dynamics, Algorithms & Software, Machine Models, Injected Intelligence, Workflows & Stakeholders//) | ||
| 125 | )))|(% style="width:222px" %)Author / Contact (optional) | ||
| 126 | |(% colspan="1" rowspan="2" %)((( | ||
| 127 | CO2 / | ||
| 128 | |||
| 129 | Footprint with regards to hardware | ||
| 130 | )))|(% style="width:1011px" %)How to handle CO2-budget of the production of the hardware (+1)|(% style="width:222px" %)Achim Stahl, support by Markus Sch (may contact Öko Institut e.V.) | ||
| 131 | |(% style="width:1011px" %)Ethical implications of Life Cycle analysis (where machines are made - where they end up)|(% style="width:222px" %) | ||
| 132 | |(% rowspan="4" %)((( | ||
| 133 | Operation of Data Centres / | ||
| 134 | |||
| 135 | Use of Energy | ||
| 136 | )))|(% style="width:1011px" %)Sustainable operation of compute and data centres |(% style="width:222px" %)Markus Sch. | ||
| 137 | |(% style="width:1011px" %)How can we integrate datacentres/experiments with their environments|(% style="width:222px" %) | ||
| 138 | |(% style="width:1011px" %)What metrics are we use to decide how clean energy is/ optimal time for greenest use of energy|(% style="width:222px" %) | ||
| 139 | |(% style="width:1011px" %)Von Stromerzeugenden und Netzbetreibern Input bekommen, was wir eigentlich tun sollen. BnetzAgentur beiholen?|(% style="width:222px" %)(Raum1) | ||
| 140 | |(% rowspan="3" %)((( | ||
| 141 | Sustainable Programming & Implications / User | ||
| 142 | |||
| |
4.1 | 143 | |
| |
8.1 | 144 | )))|(% style="width:1011px" %)Sustainable programming is a topic frequently requested by the community. How can we drive this forward? |(% style="width:222px" %)Angela Warkentin |
| 145 | |(% style="width:1011px" %)Ethical question: if software gets more efficient by factor n will then e.g. simualtion run factor n more or will stop after initial goal reached? |(% style="width:222px" %)Markus Schh. | ||
| 146 | |(% style="width:1011px" %)Wie managen mir die Wirkungen auf die Nutzenden, so dass diese mitgehen? Wie können wir für diese Motivation schaffen?|(% style="width:222px" %)(Raum 1) | ||
| 147 | |(% rowspan="4" %)Motivation & Ethics |(% style="width:1011px" %)Wie managen mir die Wirkungen auf die Nutzenden, so dass diese mitgehen? Wie können wir für diese Motivation schaffen?|(% style="width:222px" %) | ||
| 148 | |(% style="width:1011px" %)Introductions to Ethics and/in Sustainability|(% style="width:222px" %) | ||
| 149 | |(% style="width:1011px" %)UN sustainability points and the impact to physics|(% style="width:222px" %) | ||
| 150 | |(% style="width:1011px" %)Sustainability Communication: how to spread motivation among scientists |(% style="width:222px" %) | ||
| 151 | |(% rowspan="5" %)Politics & Stakeholder|(% style="width:1011px" %)Mit BMBF-Leuten darüber reden, wie wir unsere Erkenntnisse umgesetzt bekommen|(% style="width:222px" %)(Raum 1) | ||
| 152 | |(% style="width:1011px" %)Allgemeiner: Leitlinien für konkretes Handeln mit den Stakeholdern ausarbeiten.|(% style="width:222px" %)(Raum 1) | ||
| 153 | |(% style="width:1011px" %)Umgang mit politischen Zwängen (“wir gehen nicht nach Polen, weil deren Strom so dreckig ist” bzw. die Zurückweisung so einer Erwägung aus politischen Gründen)? (Or: If we fund it here we also want to run it here and not in Norway, Iceland ,... )|(% style="width:222px" %) | ||
| 154 | |(% style="width:1011px" %)Political barriers to sustainability (local laws/regulations)|(% style="width:222px" %) | ||
| 155 | |(% style="width:1011px" %)What does the BMBF expect? (Invite BMBF representative) |(% style="width:222px" %) | ||
| 156 | |(% rowspan="4" %)Teaching & Science |(% style="width:1011px" %)In view of abilities of Humans versus Machines (see table below): how will ErUM science change in future|(% style="width:222px" %)Martin E. | ||
| 157 | |(% style="width:1011px" %)Knowledge transfer, education, what concepts will stay to be important, what will be new|(% style="width:222px" %)Judith Reindl, Martin E. | ||
| 158 | |(% style="width:1011px" %)Wie managen mir die Wirkungen auf die Nutzenden, so dass diese mitgehen? Wie können wir für diese Motivation schaffen?|(% style="width:222px" %) | ||
| 159 | |(% style="width:1011px" %)Sustainability Communication: how to spread motivation among scientists |(% style="width:222px" %) | ||
| 160 | |||
| |
10.1 | 161 | |
| 162 | |||
| 163 | |||
| |
15.1 | 164 | |
| |
14.1 | 165 | === **3. Regarding Timetable ** === |
| |
10.1 | 166 | |
| 167 | |||
| 168 | * What should the program consist of? | ||
| 169 | * Should we open the workshop for contributions (abstracts) or only include invited talks? | ||
| 170 | |||
| 171 | **Ideas so far: ** | ||
| 172 | |||
| 173 | * Talks, discussion and interactive parts | ||
| 174 | ** Interactive part: tutorial on sustainable programming | ||
| 175 | * Inspiration talks for fostering our creativity, followed by the possibility to discuss and exchange. Results of the discussion could then be presented in short talks | ||
| |
11.1 | 176 | * Talks in the morning,** paper-writing sessions in the afternoon.** |
| |
10.1 | 177 | ** Different sessions have different sections to work on in Overleaf |
| 178 | ** Paper writing / Results: One moderator per session, who is also responsible for detailed documentation | ||
| 179 | |||
| |
11.1 | 180 | |
| 181 | |||
| 182 | |||
| |
15.1 | 183 | === === |
| 184 | |||
| |
14.1 | 185 | === **4. Regarding Invitations / Speaker** === |
| |
11.1 | 186 | |
| 187 | |||
| 188 | * ** **Find & Invite Experts from Organisations (CERN, DESY, BMBF): Anwendungsorientierte (application-oriented) Talks | ||
| 189 | |||
| 190 | |||
| 191 | |||
| 192 | |((( | ||
| 193 | **Topics ** | ||
| 194 | )))|(% style="width:1011px" %)((( | ||
| |
8.1 | 195 | |
| |
11.1 | 196 | )))|(% style="width:222px" %)Author / Contact (optional) |
| 197 | |(% colspan="1" rowspan="3" %)**General **|(% style="width:1011px" %)International sustainability projects in science (WLCG, EU, …)|(% style="width:222px" %) | ||
| 198 | |(% style="width:1011px" %)Overview of ideas in SUSFECIT research network (proposal handed in 2024 ErumM Data call)|(% style="width:222px" %)Markus Schumacher | ||
| 199 | |(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 200 | |(% colspan="1" rowspan="3" %)**Tracking Progress **|(% style="width:1011px" %)((( | ||
| 201 | Paper presentation: "Quantifying imperfect cognition with realized information gain" | ||
| 202 | )))|(% style="width:222px" %)Torsten Ensslin (Confirmed Participation) | ||
| 203 | |(% style="width:1011px" %)Know your footprint: status and next steps |(% style="width:222px" %)KYF authors | ||
| 204 | |(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 205 | |(% colspan="1" rowspan="2" %)((( | ||
| 206 | **CO2 /** | ||
| 207 | |||
| 208 | **Footprint with regards to hardware ** | ||
| |
12.1 | 209 | )))|(% style="width:1011px" %)Full life cycle assessment of c02 footprint (production, cooling water, disposal) |(% style="width:222px" %)could ask Öko-Institut e.V (Markus Sch,) or Matthias Wadenstein, WLCG |
| |
11.1 | 210 | |(% style="width:1011px" %) |(% style="width:222px" %) |
| 211 | |(% rowspan="3" %)((( | ||
| 212 | **Operation of Data Centres /** | ||
| 213 | |||
| 214 | **Use of Energy** | ||
| 215 | )))|(% style="width:1011px" %)((( | ||
| 216 | Ecology: How computing centres fit into the local surroundings | ||
| 217 | |||
| 218 | * Re-using waste heat to provide heat for farming: vegetables | ||
| 219 | * Novel power sources for datacentres, building datacentres where power is being generated | ||
| 220 | )))|(% style="width:222px" %) | ||
| 221 | |(% style="width:1011px" %)Sustainability implementation at major research facilities e.g. CERN, DESY (e.g. Serge Claudet, Cern energy management panel)|(% style="width:222px" %)Guenter Duckeck | ||
| 222 | |(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 223 | |(% rowspan="2" %)((( | ||
| 224 | **Sustainable Programming & Implications / User ** | ||
| 225 | |||
| 226 | |||
| 227 | )))|(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 228 | |(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 229 | |(% rowspan="4" %)**Motivation & Ethics **|(% style="width:1011px" %)((( | ||
| 230 | "Warum föderierte, standardsbasierte Infrastrukturen ethische Implikationen haben, sowohl was Vermeidung von Lock-in und ständiger Obszoleszenz betrifft als auch, was gleichen Zugang für alle, von Server- wie von Clientseite aus, angeht. (Abdeckung z.B. durch Markus Demleitner im Rahmen eines 10 Min Frühstückgesprächs möglich)" | ||
| 231 | |||
| 232 | Why federated, standards-based infrastructures have ethical implications, both in terms of avoiding lock-in and constant obsolescence, as well as ensuring equal access for all, from both the server and client side. (Coverage, e.g., by Markus Demleitner in the context of a 10-minute breakfast discussion, is possible) | ||
| 233 | )))|(% style="width:222px" %)Markus Demleitner | ||
| 234 | |(% style="width:1011px" %)((( | ||
| 235 | * RWTH Aachen AI Center Ethik Kommission: [[https:~~/~~/www.ai.rwth-aachen.de/cms/KI/Das-KI-Center/~~~~gglha/Team/>>url:https://www.ai.rwth-aachen.de/cms/KI/Das-KI-Center/~~gglha/Team/]] | ||
| 236 | ** [[Prof. h.c. Dr. h.c. Dr. ir. Wil van der Aalst>>url:https://www.pads.rwth-aachen.de/cms/pads/der-lehrstuhl/team/professor/~~pxtb/wil-van-der-aalst/]]: Fairness und Privacy | ||
| 237 | ** [[Prof. Dr. Saskia Nagel>>url:https://www.ethics.rwth-aachen.de/cms/ETHICS/Das-Lehr-und-Forschungsgebiet/Team/~~fcnwz/Saskia-Nagel/]] Ethics of AI, Impact of AI on Individuals and Society | ||
| 238 | ** [[Prof. Dr. rer. pol. Frank Piller>>url:https://www.time.rwth-aachen.de/cms/TIME/Die-Research-Area/Technologie-und-Innovationsmanagement-/TIM-Team/Lehrstuhlinhaber/~~eebc/Piller-Frank-T/]] Social Effects and Acceptance of AI | ||
| 239 | ** [[Prof. Dr. rer. nat. Astrid Rosenthal-von der Pütten>>url:https://www.itec.rwth-aachen.de/cms/ITEC/Der-Lehrstuhl/Team/~~szbg/Rosenthal-von-der-Puetten-Astrid/]] Human-Agent Interaction · Human and AI Shared Decision Making · Human-Robot Interaction · Social Effects and Acceptance of AI | ||
| 240 | ** [[Prof. Dr. Claudia Wagner>>url:http://claudiawagner.info/]] Natural Language processing · Network Science · Computational Social Science · Fairness of AI | ||
| 241 | * Benediktiner Pater Christoph Gerhard (Sustainability and ethics) | ||
| 242 | * Johannes Hartel (Sustainability and ethics) | ||
| 243 | * “Lesch sieht Schwartz” (zdf Harald Lesch und Pfarrer Thomas Schwartz) | ||
| 244 | * Prof. Dr. Dr. Wolfgang Rhode | ||
| 245 | )))|(% style="width:222px" %)Jan Bürger | ||
| 246 | |(% style="width:1011px" %)Invite someone from the Deutscher Ethikrat talking about assessment of technologies in the domain of “AI++”|(% style="width:222px" %)Achim Streit, Martin Erdmann, Thomas Kuhr, Judith Reindl | ||
| 247 | |(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 248 | |(% rowspan="2" %)**Politics & Stakeholder / Implementation **|(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 249 | |(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 250 | |(% rowspan="2" %)**Teaching & Science **|(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 251 | |(% style="width:1011px" %) |(% style="width:222px" %) | ||
| 252 | |||
| |
17.1 | 253 | |
| 254 | |||
| 255 | |||
| 256 | Consider: | ||
| 257 | |||
| 258 | | |Distinctive Human Skills|How GenAI can supplement learning processes⁺ | ||
| 259 | |Create|Engage in both creative and cognitive processes that leverage human lived experiences, social-emotional interactions, intuition, reflection, and judgment to formulate original solutions.|Support brainstorming processes; suggest a range of alternatives; enumerate potential drawbacks and advantages; describe successful real-world cases; create a tangible deliverable based on human inputs | ||
| 260 | |Evaluate|Engage in metacognitive reflection; holistically appraise ethical consequences of alternative courses of action; identify significance or situate within a full historical or disciplinary context|Identify pros and cons of various courses of action; develop and check against evaluation rubrics | ||
| 261 | |Analyze|Critically think and reason within the cognitive and affective domains; justify analysis in depth and with clarity|Compare and contrast data, infer trends and themes in a narrowly-defined context; compute; predict; interpret and relate to real-world problems, decisions, and choices | ||
| 262 | |Apply|Operate, implement, conduct, execute, experiment, and test in the real world; apply human creativity and imagination to idea and solution development|Make use of a process, model, or method to solve a quantitative or qualitative inquiry; assist students in determining where they went wrong while solving a problem | ||
| 263 | |Understand|Contextualize answers within emotional, moral, or ethical considerations; select relevant information; explain significance|Accurately describe a concept in different words; recognize a related example; translate to another language | ||
| 264 | |Remember|Recall information in situations where technology is not readily accessible|Retrieve factual information; list possible answers; define a term; construct a basic chronology or timeline | ||
| 265 | |||
| |
11.1 | 266 |
