大數(shù)據(jù)與并行計算

Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,Click to edit Master title style,Click to edit Master text styles,Second level,Third level,Fourth level,Fifth level,*,*,大數(shù)據(jù)處理,大數(shù)據(jù)與并行計算,中 南 大 學,信息科學與工程學院,大數(shù)據(jù)時代：是變革還是煩惱,科學畫報,2013.10,1.,解讀大數(shù)據(jù),a.,2009,年，“大數(shù)據(jù)”脫穎而出,b.,手機、平板電腦；物聯(lián)網(wǎng)、云計算、移動互聯(lián)網(wǎng),c.,定義：大而復雜、難以用現(xiàn)有數(shù)據(jù)庫管理工具處理的數(shù)據(jù)集。,2.Big Data,內(nèi)涵,a.,數(shù)量巨大、來源多樣化、類型多樣化,b.,新型數(shù)據(jù)處理和分析技術(shù),c.,運用新型數(shù)據(jù)分析技術(shù)所形成的具有價值的結(jié)果,3.,實現(xiàn)準確的預測,d.,亞馬孫賣書的推薦系統(tǒng),2007,年,.90%,以上都已數(shù)字信息化,10/21/2024,10/21/2024,Hype Cycle for Emerging Technologies,10/21/2024,并行計算,多核,多處理器,分布式計算,10/21/2024,10/21/2024,多核的發(fā)展必然,10/21/2024,10/21/2024,10/21/2024,多核編程內(nèi)容,多核編程內(nèi)容,OpenMP,用于共享內(nèi)存并行系統(tǒng)的多線程程序設計的一套指導性的編譯處理方案。,OpenMP,支持的編程語言包括,C,語言、,C+,和,Fortran,。,OpenMP,提供了對并行算法的高層的抽象描述，程序員通過在源代碼中加入專用的,pragma,來指明自己的意圖，由此編譯器可以自動將程序進行并行化，并在必要之處加入同步互斥以及通信。,MPI,作為消息傳遞機制，在,PC,、工作站、以及各種并行機上運行,10/21/2024,并行計算機,10/21/2024,10/21/2024,技術(shù)墻,10/21/2024,結(jié)論,分布式計算是大數(shù)據(jù)時代的必然趨勢！,10/21/2024,分布式計算是大數(shù)據(jù)時代的必然趨勢,所謂分布式計算是一門計算機科學，它研究如何,把一個需要非常巨大的計算能力才能解決的問題分成許多小的部分，然后把這些部分分配給許多計算機進行處理,，最后把這些計算結(jié)果綜合起來得到最終的結(jié)果。,10/21/2024,非常巨大的計算能力才能解決的問題,解決較為復雜的數(shù)學問題,研究尋找最為安全的密碼系統(tǒng),如密碼破解,生物病理研究,研究蛋白質(zhì)折疊，誤解，聚合及由此引起的相關(guān)疾病,各種各樣疾病的藥物研究，尋找對抗癌癥的有效的藥物,信號處理,這些問題都應該由超級計算機來解決,!,10/21/2024,Big Data,Where to Go,