DOI: 10.1006/jcss.1997.1504. A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting

A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting

10.1006/jcss.1997.1504

Crossref journal-article

Elsevier BV

Journal of Computer and System Sciences (78)

Bibliography

Freund, Y., & Schapire, R. E. (1997). A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting. Journal of Computer and System Sciences, 55(1), 119â139.

Authors 2

Yoav Freund (first)
Robert E Schapire (additional)

References 26 Referenced 12,279

{'key': '10.1006/jcss.1997.1504_SS971504RF1', 'first-page': '81', 'article-title': 'What size net gives valid generalization?', 'author': 'Baum', 'year': '1989', 'journal-title': 'Adv. Neural Inform. Process. Systems I'} / Adv. Neural Inform. Process. Systems I / What size net gives valid generalization? by Baum (1989)
10.2140/pjm.1956.6.1 / Pacific J. Math. / An analog of the minimax theorem for vector payoffs by Blackwell (1956)
L. Breiman, 1996, Bias, variance, and arcing classifiers, Statistics Dept. University of California
N. Cesa-Bianchi, Y. Freund, D. P. Helmhold, D. Haussler, R. E. Schapire, M. K. Warmuth, How to use expert advice, Proceedings of the Twenty-Fifth Annual ACM Symposium on the Theory of Computing, 1993, 382, 391 (10.1145/167088.167198)
T. H. Chung, Approximate methods for sequential decision making using expert advice, Proceedings of the Seventh Annual ACM Conference on Computational Learning Theory, 1994, 183, 189 (10.1145/180139.181097)
10.1111/j.1467-9965.1991.tb00002.x / Math. Finance / Universal portfolios by Cover (1991)
10.1613/jair.105 / J. Artif. Intell. Res. / Solving multiclass learning problems via error-correcting output codes by Dietterich (1995)
{'key': '10.1006/jcss.1997.1504_SS971504RF8', 'article-title': 'Boosting decision trees', 'volume': '8', 'author': 'Drucker', 'year': '1996', 'journal-title': 'Adv. Neural Inform. Process. Systems'} / Adv. Neural Inform. Process. Systems / Boosting decision trees by Drucker (1996)
10.1142/S0218001493000352 / Int. J. Pattern Recognition Artif. Intell. / Boosting performance in neural networks by Drucker (1993)
Y. Freund, 1993, Data Filtering and Distribution Modeling Algorithms for Machine Learning, University of California at Santa Cruz
10.1006/inco.1995.1136 / Inform. and Comput. / Boosting a weak learning algorithm by majority by Freund (1995)
Y. Freund, R. E. Schapire, Experiments with a new boosting algorithm, Machine Learning: Proceedings of the Thirteenth International Conference, 1996, 148, 156
Y. Freund, R. E. Schapire, Game theory, on-line prediction and boosting, Proceedings of the Ninth Annual Conference on Computational Learning Theory, 1996, 325, 332 (10.1145/238061.238163)
{'key': '10.1006/jcss.1997.1504_SS971504RF14', 'series-title': 'Contributions to the Theory of Games', 'article-title': 'Approximation to Bayes risk in repeated play', 'author': 'Hannan', 'year': '1957'} / Contributions to the Theory of Games / Approximation to Bayes risk in repeated play by Hannan (1957)
{'key': '10.1006/jcss.1997.1504_SS971504RF15', 'series-title': "Computational Learning Theory: Second European Conference, EuroCOLT '95", 'article-title': 'Tight worst-case loss bounds for predicting with expert advice', 'author': 'Haussler', 'year': '1995'} / Computational Learning Theory: Second European Conference, EuroCOLT '95 / Tight worst-case loss bounds for predicting with expert advice by Haussler (1995)
{'key': '10.1006/jcss.1997.1504_SS971504RF16', 'article-title': 'Learning sparse perceptrons', 'volume': '8', 'author': 'Jackson', 'year': '1996', 'journal-title': 'Adv. Neural Inform. Process. Systems'} / Adv. Neural Inform. Process. Systems / Learning sparse perceptrons by Jackson (1996)
M. Kearns, Y. Mansour, A. Y. Ng, D. Ron, An experimental and theoretical comparison of model selection methods, Proceedings of the Eighth Annual Conference on Computational Learning Theory, 1995 (10.1145/225298.225301)
{'year': '1994', 'series-title': 'An Introduction to Computational Learning Theory', 'author': 'Kearns', 'key': '10.1006/jcss.1997.1504_SS971504RF18'} / An Introduction to Computational Learning Theory by Kearns (1994)
{'key': '10.1006/jcss.1997.1504_SS971504RF19', 'series-title': "Computational Learning Theory: EuroCOLT '93", 'article-title': 'Using experts for predicting continuous outcomes', 'author': 'Kivinen', 'year': '1994'} / Computational Learning Theory: EuroCOLT '93 / Using experts for predicting continuous outcomes by Kivinen (1994)
10.1006/inco.1994.1009 / Inform. and Comput. / The weighted majority algorithm by Littlestone (1994)
J. R. Quinlan, Bagging, boosting, and C4.5, Proceedings, Fourteenth National Conference on Artificial Intelligence, 1996
10.1007/BF00116037 / Machine Learning / The strength of weak learnability by Schapire (1990)
{'year': '1982', 'series-title': 'Estimation of Dependences Based on Empirical Data', 'author': 'Vapnik', 'key': '10.1006/jcss.1997.1504_SS971504RF23'} / Estimation of Dependences Based on Empirical Data by Vapnik (1982)
V. G. Vovk, A game of prediction with expert advice, Proceedings of the Eighth Annual Conference on Computational Learning Theory, 1995 (10.1145/225298.225304)
V. G. Vovk, Aggregating strategies, Proceedings of the Third Annual Workshop on Computational Learning Theory, 1990, 321, 383 (10.1016/B978-1-55860-146-8.50032-1)
10.1016/0012-365X(81)90274-0 / Discrete Mathematics / Some special Vapnik–Chervonenkis classes by Wenocur (1981)

Dates

Type	When
Created	22 years, 11 months ago (Sept. 18, 2002, 6:19 a.m.)
Deposited	5 years, 8 months ago (Dec. 16, 2019, 3:57 a.m.)
Indexed	27 minutes ago (Aug. 29, 2025, 12:28 p.m.)
Issued	28 years ago (Aug. 1, 1997)
Published	28 years ago (Aug. 1, 1997)
Published Print	28 years ago (Aug. 1, 1997)

Funders 0

None

BibTeX

@article{Freund_1997, title={A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting}, volume={55}, ISSN={0022-0000}, url={http://dx.doi.org/10.1006/jcss.1997.1504}, DOI={10.1006/jcss.1997.1504}, number={1}, journal={Journal of Computer and System Sciences}, publisher={Elsevier BV}, author={Freund, Yoav and Schapire, Robert E}, year={1997}, month=aug, pages={119–139} }

JSON

{
  "indexed": {
    "date-parts": [
      [
        2025,
        8,
        29
      ]
    ],
    "date-time": "2025-08-29T16:28:34Z",
    "timestamp": 1756484914036
  },
  "reference-count": 26,
  "publisher": "Elsevier BV",
  "issue": "1",
  "license": [
    {
      "start": {
        "date-parts": [
          [
            1997,
            8,
            1
          ]
        ],
        "date-time": "1997-08-01T00:00:00Z",
        "timestamp": 870393600000
      },
      "content-version": "tdm",
      "delay-in-days": 0,
      "URL": "https://www.elsevier.com/tdm/userlicense/1.0/"
    },
    {
      "start": {
        "date-parts": [
          [
            2013,
            7,
            17
          ]
        ],
        "date-time": "2013-07-17T00:00:00Z",
        "timestamp": 1374019200000
      },
      "content-version": "vor",
      "delay-in-days": 5829,
      "URL": "https://www.elsevier.com/open-access/userlicense/1.0/"
    }
  ],
  "content-domain": {
    "domain": [],
    "crossmark-restriction": false
  },
  "published-print": {
    "date-parts": [
      [
        1997,
        8
      ]
    ]
  },
  "DOI": "10.1006/jcss.1997.1504",
  "type": "journal-article",
  "created": {
    "date-parts": [
      [
        2002,
        9,
        18
      ]
    ],
    "date-time": "2002-09-18T10:19:44Z",
    "timestamp": 1032344384000
  },
  "page": "119-139",
  "source": "Crossref",
  "is-referenced-by-count": 12279,
  "title": "A Decision-Theoretic Generalization of On-Line Learning and an Application to Boosting",
  "prefix": "10.1006",
  "volume": "55",
  "author": [
    {
      "given": "Yoav",
      "family": "Freund",
      "sequence": "first",
      "affiliation": []
    },
    {
      "given": "Robert E",
      "family": "Schapire",
      "sequence": "additional",
      "affiliation": []
    }
  ],
  "member": "78",
  "reference": [
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF1",
      "first-page": "81",
      "article-title": "What size net gives valid generalization?",
      "author": "Baum",
      "year": "1989",
      "journal-title": "Adv. Neural Inform. Process. Systems I"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF2",
      "doi-asserted-by": "crossref",
      "first-page": "1",
      "DOI": "10.2140/pjm.1956.6.1",
      "article-title": "An analog of the minimax theorem for vector payoffs",
      "volume": "6",
      "author": "Blackwell",
      "year": "1956",
      "journal-title": "Pacific J. Math."
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF3",
      "unstructured": "L. Breiman, 1996, Bias, variance, and arcing classifiers, Statistics Dept. University of California"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF4",
      "doi-asserted-by": "crossref",
      "unstructured": "N. Cesa-Bianchi, Y. Freund, D. P. Helmhold, D. Haussler, R. E. Schapire, M. K. Warmuth, How to use expert advice, Proceedings of the Twenty-Fifth Annual ACM Symposium on the Theory of Computing, 1993, 382, 391",
      "DOI": "10.1145/167088.167198"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF5",
      "doi-asserted-by": "crossref",
      "unstructured": "T. H. Chung, Approximate methods for sequential decision making using expert advice, Proceedings of the Seventh Annual ACM Conference on Computational Learning Theory, 1994, 183, 189",
      "DOI": "10.1145/180139.181097"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF6",
      "doi-asserted-by": "crossref",
      "first-page": "1",
      "DOI": "10.1111/j.1467-9965.1991.tb00002.x",
      "article-title": "Universal portfolios",
      "volume": "1",
      "author": "Cover",
      "year": "1991",
      "journal-title": "Math. Finance"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF7",
      "doi-asserted-by": "crossref",
      "first-page": "263",
      "DOI": "10.1613/jair.105",
      "article-title": "Solving multiclass learning problems via error-correcting output codes",
      "volume": "2",
      "author": "Dietterich",
      "year": "1995",
      "journal-title": "J. Artif. Intell. Res."
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF8",
      "article-title": "Boosting decision trees",
      "volume": "8",
      "author": "Drucker",
      "year": "1996",
      "journal-title": "Adv. Neural Inform. Process. Systems"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF9",
      "doi-asserted-by": "crossref",
      "first-page": "705",
      "DOI": "10.1142/S0218001493000352",
      "article-title": "Boosting performance in neural networks",
      "volume": "7",
      "author": "Drucker",
      "year": "1993",
      "journal-title": "Int. J. Pattern Recognition Artif. Intell."
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF10",
      "unstructured": "Y. Freund, 1993, Data Filtering and Distribution Modeling Algorithms for Machine Learning, University of California at Santa Cruz"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF11",
      "doi-asserted-by": "crossref",
      "first-page": "256",
      "DOI": "10.1006/inco.1995.1136",
      "article-title": "Boosting a weak learning algorithm by majority",
      "volume": "121",
      "author": "Freund",
      "year": "1995",
      "journal-title": "Inform. and Comput."
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF12",
      "unstructured": "Y. Freund, R. E. Schapire, Experiments with a new boosting algorithm, Machine Learning: Proceedings of the Thirteenth International Conference, 1996, 148, 156"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF13",
      "doi-asserted-by": "crossref",
      "unstructured": "Y. Freund, R. E. Schapire, Game theory, on-line prediction and boosting, Proceedings of the Ninth Annual Conference on Computational Learning Theory, 1996, 325, 332",
      "DOI": "10.1145/238061.238163"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF14",
      "series-title": "Contributions to the Theory of Games",
      "article-title": "Approximation to Bayes risk in repeated play",
      "author": "Hannan",
      "year": "1957"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF15",
      "series-title": "Computational Learning Theory: Second European Conference, EuroCOLT '95",
      "article-title": "Tight worst-case loss bounds for predicting with expert advice",
      "author": "Haussler",
      "year": "1995"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF16",
      "article-title": "Learning sparse perceptrons",
      "volume": "8",
      "author": "Jackson",
      "year": "1996",
      "journal-title": "Adv. Neural Inform. Process. Systems"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF17",
      "doi-asserted-by": "crossref",
      "unstructured": "M. Kearns, Y. Mansour, A. Y. Ng, D. Ron, An experimental and theoretical comparison of model selection methods, Proceedings of the Eighth Annual Conference on Computational Learning Theory, 1995",
      "DOI": "10.1145/225298.225301"
    },
    {
      "year": "1994",
      "series-title": "An Introduction to Computational Learning Theory",
      "author": "Kearns",
      "key": "10.1006/jcss.1997.1504_SS971504RF18"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF19",
      "series-title": "Computational Learning Theory: EuroCOLT '93",
      "article-title": "Using experts for predicting continuous outcomes",
      "author": "Kivinen",
      "year": "1994"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF20",
      "doi-asserted-by": "crossref",
      "first-page": "212",
      "DOI": "10.1006/inco.1994.1009",
      "article-title": "The weighted majority algorithm",
      "volume": "108",
      "author": "Littlestone",
      "year": "1994",
      "journal-title": "Inform. and Comput."
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF21",
      "unstructured": "J. R. Quinlan, Bagging, boosting, and C4.5, Proceedings, Fourteenth National Conference on Artificial Intelligence, 1996"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF22",
      "doi-asserted-by": "crossref",
      "first-page": "197",
      "DOI": "10.1007/BF00116037",
      "article-title": "The strength of weak learnability",
      "volume": "5",
      "author": "Schapire",
      "year": "1990",
      "journal-title": "Machine Learning"
    },
    {
      "year": "1982",
      "series-title": "Estimation of Dependences Based on Empirical Data",
      "author": "Vapnik",
      "key": "10.1006/jcss.1997.1504_SS971504RF23"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF24",
      "doi-asserted-by": "crossref",
      "unstructured": "V. G. Vovk, A game of prediction with expert advice, Proceedings of the Eighth Annual Conference on Computational Learning Theory, 1995",
      "DOI": "10.1145/225298.225304"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF25",
      "doi-asserted-by": "crossref",
      "unstructured": "V. G. Vovk, Aggregating strategies, Proceedings of the Third Annual Workshop on Computational Learning Theory, 1990, 321, 383",
      "DOI": "10.1016/B978-1-55860-146-8.50032-1"
    },
    {
      "key": "10.1006/jcss.1997.1504_SS971504RF26",
      "doi-asserted-by": "crossref",
      "first-page": "313",
      "DOI": "10.1016/0012-365X(81)90274-0",
      "article-title": "Some special Vapnik\u2013Chervonenkis classes",
      "volume": "33",
      "author": "Wenocur",
      "year": "1981",
      "journal-title": "Discrete Mathematics"
    }
  ],
  "container-title": "Journal of Computer and System Sciences",
  "original-title": [],
  "language": "en",
  "link": [
    {
      "URL": "https://api.elsevier.com/content/article/PII:S002200009791504X?httpAccept=text/xml",
      "content-type": "text/xml",
      "content-version": "vor",
      "intended-application": "text-mining"
    },
    {
      "URL": "https://api.elsevier.com/content/article/PII:S002200009791504X?httpAccept=text/plain",
      "content-type": "text/plain",
      "content-version": "vor",
      "intended-application": "text-mining"
    }
  ],
  "deposited": {
    "date-parts": [
      [
        2019,
        12,
        16
      ]
    ],
    "date-time": "2019-12-16T08:57:01Z",
    "timestamp": 1576486621000
  },
  "score": 1,
  "resource": {
    "primary": {
      "URL": "https://linkinghub.elsevier.com/retrieve/pii/S002200009791504X"
    }
  },
  "subtitle": [],
  "short-title": [],
  "issued": {
    "date-parts": [
      [
        1997,
        8
      ]
    ]
  },
  "references-count": 26,
  "journal-issue": {
    "issue": "1",
    "published-print": {
      "date-parts": [
        [
          1997,
          8
        ]
      ]
    }
  },
  "alternative-id": [
    "S002200009791504X"
  ],
  "URL": "http://dx.doi.org/10.1006/jcss.1997.1504",
  "relation": {},
  "ISSN": [
    "0022-0000"
  ],
  "subject": [],
  "container-title-short": "Journal of Computer and System Sciences",
  "published": {
    "date-parts": [
      [
        1997,
        8
      ]
    ]
  }
}