定理回答哪個世界的問題 Which world does the theorem describe?

編輯閱讀框架 Editorial reading framework

學習理論與最佳化 Learning Theory & Optimization

用假設、保證、適用範圍與失效案例四格,快速判斷定理的解釋範圍。 Use assumptions, guarantee, regime, and failure case to judge a theorem's explanatory range.

這是編輯整理的讀論文框架。This is an editorial framework for reading papers.

定理、假設與實驗回答不同問題,閱讀時不要互相代替;個別主張請依論文卡片標出的原文位置核對。 Theorems, assumptions, and experiments answer different questions and should not stand in for one another. Use each paper card's source location to check a specific claim.

頁內情境、比喻與練習用來建立判讀方法,不代表特定論文的研究結果。Scenarios, analogies, and exercises teach a reading method; they are not findings from a specific paper.

查看此主題論文與原文證據View papers and source evidence for this topic →
32分鐘minutes
3學習目標objectives
7學習階段phases
01定位Orient

先看這個問題為什麼值得解Why this problem is worth solving

情境先行Start with the situation

編輯示例 · 用於建立直覺Editorial example · for intuition
地圖可以非常精確,但如果畫的是另一座城市,精確度幫不了你回家。定理的 assumptions 就是城市邊界。 A map can be precise yet useless if it depicts another city. Theorem assumptions define the city limits.

只看 rate 或 bound 大小,會忽略它是否適用於關心的資料、模型與步數。 Reading only rates or bound sizes ignores whether they apply to the data, model, and horizon of interest.

先備知識Prerequisite

  • 看得懂 expectation、norm 與 big-O Can read expectations, norms, and big-O notation

讀完你能做到After this path

  • 從定理抽出假設與保證 Extract assumptions and guarantees from a theorem
  • 辨識漸近結果與有限範圍的差異 Distinguish asymptotic and finite regimes
  • 設計會讓保證失效的邊界案例 Design an edge case that breaks the guarantee

閱讀框架Concept frame

核心問題Question
更緊的界線(bound),是否一定更接近實際深度學習? Does a tighter bound necessarily say more about practical deep learning?
對照軸Comparison axis
實際 regime 與 theorem assumptions 的距離 Distance from theorem assumptions
判讀方式Evidence to inspect
並排閱讀三種相對情境,再回到論文檢查消融實驗、反事實測試與適用範圍。Read three relative scenarios side by side, then inspect the paper's ablations, counterfactual tests, and scope statements.
02預測Predict

回答後查看解析Answer, then view the explanation

你的預測Make a prediction

比較兩個 convergence bound 時,第一步是什麼? What is the first step when comparing two convergence bounds?

比較兩個 convergence bound 時,第一步是什麼? What is the first step when comparing two convergence bounds?
03觀察Observe

看現象,不急著講故事Observe before narrating

三個診斷訊號Three diagnostic signals

你看到You observe先讀成Read first as
bound 對維度呈指數成長 The bound grows exponentially with dimension 高維 regime 可能 vacuous It may be vacuous in high dimensions
保證要求未知參數設定 step size Step size depends on an unknown parameter 實作需要估計或自適應版本 Practice needs estimation or adaptation
toy experiment 符合但實際模型未測 Toy experiments match, real models untested 機制證據與外推要分開 Mechanism evidence and extrapolation differ

這些是待檢查的診斷假說。下一步用條件比較、消融實驗或反事實測試排除其他解釋。These are diagnostic hypotheses to test. Use condition comparisons, ablations, or counterfactual tests to rule out alternatives.

04對照Compare

一次看完三種情境Read three scenarios side by side

三種情境對照Three-scenario comparison

哪個 assumption 最值得先放鬆,為什麼? Which assumption should be relaxed first, and why?

對照軸:Comparison axis: 實際 regime 與 theorem assumptions 的距離 Distance from theorem assumptions

較低Lower

可直接測 rate、常數與 tightness。 Rates, constants, and tightness can be tested directly.

中等Middle

應逐項做 assumption stress test。 Stress-test assumptions one at a time.

較高Higher

定理主要提供機制直覺,不應當成數值預測。 Treat the theorem as mechanism intuition, not a numerical forecast.

05解釋Explain

從直覺到機制From intuition to mechanism

把機制講清楚Explain the mechanism

直覺Intuition

定理是一份有條件的契約:條件成立,就保證某件事;不是無條件預言。 A theorem is a conditional contract: meet the assumptions and receive a guarantee—not an unconditional prophecy.

輸入與輸出Inputs & outputs

輸入是問題設定與假設;輸出是形式化保證;目標是刻畫可能性、極限或機制。 Input: a problem setting and assumptions. Output: a guarantee. Objective: characterize possibility, limits, or mechanism.

  1. 01 列出資料、模型、loss 與 algorithm assumptions。 List data, model, loss, and algorithm assumptions.
  2. 02 確認 guarantee 的 metric、機率與時間尺度。 Identify the guarantee's metric, probability, and horizon.
  3. 03 找 tight example、lower bound 或 assumption violation。 Find tight examples, lower bounds, or assumption violations.
常見陷阱Common pitfall

把 asymptotic rate 的改善直接翻譯成有限算力下的速度。 Translating a better asymptotic rate directly into finite-compute speed.

小結Summary

四格閱讀法:assumptions、guarantee、regime、failure case。 Use four boxes: assumptions, guarantee, regime, and failure case.

06回想Recall

不用回看頁面的自我檢查Check your recall without looking back

三個回想題Three recall questions

先口頭回答,再展開解析。Answer aloud before opening each explanation.

01 vacuous bound 是什麼? What is a vacuous bound?

形式上正確,但在關心的參數範圍沒有提供有用限制。 A formally correct bound that gives no useful restriction in the relevant regime.

02 為何常數不能總被 big-O 忽略? Why can constants not always be ignored in big-O?

有限資料與有限步數下,常數可能主導實際大小。 At finite data and horizons, constants may dominate.

03 assumption stress test 怎麼做? How do you stress-test an assumption?

固定其他條件,逐步違反該 assumption,觀察 guarantee 對應現象是否消失。 Hold others fixed, violate one assumption progressively, and observe whether the guaranteed behavior disappears.

07遷移Transfer

把工具帶回你的研究Take the tool back to your research

最後一個任務One final task

從一篇理論論文挑主定理,做一張四格卡,再寫一個會讓其中一項 assumption 失效的資料例子。 Take a main theorem, fill a four-box card, then construct data that violates one assumption.

留給下一段專注時間For your next focus block

閱讀清單Reading queue

只存於這個瀏覽器。先排問題,不要只是囤連結。 Stored only in this browser. Queue questions, not just links.

清單還是空的。從論文探索器加入第一篇。 Your queue is empty. Add a first paper from the explorer.

比較欄位:問題、方法、結果、限制Compare: question, method, results, limitations

論文並排比較Paper comparison