位置：成果数据库 > 期刊 > 期刊详情页
基于Celery的分布式视频计算处理框架
  • ISSN号：1002-8692
  • 期刊名称：《电视技术》
  • 时间：0
  • 分类：TP338.8[自动化与计算机技术—计算机系统结构;自动化与计算机技术—计算机科学与技术]
  • 作者机构：上海交通大学电子工程系图像通信与网络工程研究所,上海200240
  • 相关基金：国家自然科学基金项目（61221001）
作者： 霍达, 宋利
关键词： 分布式计算, 云计算, 转码, distributed computing , cloud computing , transcoding
中文摘要：

为了实现能够快速高效的使用计算集群解决视频计算问题，提出一种基于Celery的分布式视频处理框架，该框架借鉴了Hadoop的架构设计，提出了API服务器层，JobTracker和TaskTracker的三层架构，并对其进行了优化使之能够兼容计算资源与存储资源的横向扩展和新的计算应用的纵向扩展。详细描述了框架的架构设计和优化设计。实验数据证明分布式计算框架能够高效地利用多节点实现视频计算。

英文摘要：

In view of using computer cluster to solve video processing problem, a distributed video processing system based on celery is proposed in this paper. Using Hadoop＇ s structure as a reference, a three-tier structure is presented, including API server layer, JobTraeker layer and TaskTracker layer. This structure enables the system to be compatible with both computing resource and functional extension. In this paper, structure of the system is presented in detail together with optimization. The experimental data indicate that the system is proved to be efficient with muhiple calculating nodes.

同期刊论文项目
数字媒体通信理论与关键技术
期刊论文 94 会议论文 104
同项目期刊论文
Outage Analysis of Cooperative Secrecy Multicast Transmission
Wavelength-tunable Light Sources Based on a Self-seeding RSOA
Generalized Equalization Model forImage Enhancement
Neighbor Discovery Algorithms in Directional Antenna based Synchronous and Asynchronous Wireless Ad
Foreground Estimation Based on Linear Regression Model with Fused Sparsity on Outliers
Parallel Hough Transform-Based Straight Line Detection and Its FPGA Implementation in Embeddd Vision
Wavelet-basedhybrid natural image modeling using generalized Gaussian and α-stabledistributions
Variable LLR Scaling in Min-Sum Decoding for Irregular LDPC Codes
On Content-centric Wireless Delivery Networks
Throughput and Delay in Heterogeneous Cognitive Radio Networks with Cooperative Secondary Users
Analysis of Random Walk Mobility Models with Location Heterogeneity
Asymptotic Analysis on Throughput and Delay in Cognitive Social Networks
Interference Exploitation in D2D-enabled Cellular Networks: A Secrecy Perspective
Secure beamforming for MIMO two-way communications with an untrusted relay
Push-based Wireless Converged Networks for Massive Multimedia Content Delivery
Function Computation over Heterogeneous Wireless Sensor Networks
The Role of Location Popularity in Multicast Mobile Ad Hoc Networks
Vector Gaussian Multiterminal Source Coding
On two stage sequential coding of correlated sources
An Urban-Rural Dual Structure for the Digital Terrestrial Television Broadcasting System of FOBTV
Massive MIMO multicasting in noncooperative cellular networks
Delay-Power-Rate-distortion Model for Wireless Video Communication Under Delay and Energy Constraint
A New Algorithm for Inferring User Search Goals with FeedbackSessions
Stochastic Throughput Optimization for Two-hop Systems with Finite Relay Buffers
Compressed Channel Estimation with Position-Based ICI Elimination for High-Mobility SIMO-OFDM System
Consistency-Driven Alternating Optimization for Multi-Graph Matching: a Unified Approach
Single Image SuperResolution Based on Gradient Profile Sharpness
Noise Estimation of Natural Images viaStatistical Analysis and Noise Injection
A ReconfigurableTangram Model for Scene Representation and Categorization
Single Image Super-resolution with Detail Enhancement based onLocal Fractal Analysis of Gradient
On the Throughput and Delay in Ad-Hoc Networks with Human Mobility
Database-Assisted Dynamic Spectrum Access with QoS Guarantees: A Double-Phase Auction Approach
Active Learning for Web Search Ranking via Noise Injection
The analysis of image contrast: From quality assessment to automatic enhancement
No-reference image sharpness assessment in autoregressive parameter space
Quality assessment considering viewing distance and image resolution
Active Learning for Ranking through Expected Loss Optimization
Near-Optimal Scheme for Cognitive Radio Networks with Heterogeneous Mobile Secondary Users
Cooperation Improves Delay in Cognitive Networks with Hybrid Random Walk
On Multicast Capacity and Delay in Cognitive Radio Mobile Ad-hoc Networks
Mobility Weakens the Distinction between Multicast and Unicast
Impact of Social Relation and Group Size in Multicast Ad Hoc Networks
Non-Asymptotic Multicast Throughput and Delay in Multi-Hop Wireless Networks
Data Dissemination with Network Coding in Two-Way Vehicle-to-Vehicle Networks
Suppression of SRS induced crosstalk in RF-video overlay TWDM-PON system using dicode coding
Power Budget Improved Symmetric 40-Gb/s Long Reach Stacked WDM-OFDM-PON System Based on Single Tunab
Survivable Wavelength-division Multiplexing Passive Optical Network System with Centralized Protecti
Topology Analysis of Wireless Sensor Networks Based on Nodes’ Spatial Distribution
Inferring User Image-Search Goals under the Implicit Guidance of Users
Hybrid No-Reference Quality Metric for Singly and Multiply Distorted Images
Power budget improvement of symmetric 40-Gb/s DML-based TWDM-PON system
Energy Efficient TWDM Multi-PON System With Wavelength Relocation
20-Gbps low cost WDM-OFDM-PON downstream transmission with tunable filter and linear APD module
A Reconfigurable High-Order UWB Signal Generation Scheme Using RSOA-MZI Structure
Bandwidth analysis of all-optical turbo-switch
Physical-layer energy-efficient receiving method based on selective sampling in orthogonal frequency
Are What You Watch and When You Watch: Inferring Household Structures From IPTV Viewing Data
HNOC2.0 系统中高速LDPC译码器结构设计
Visual saliency detection with free energy theory
超高清电视发展趋势研究
基于负载自适应的Ad Hoc网视频传输队列调度算法
下一代数字电视广播IP封装与传输技术研究
基于白频谱技术的数字电视上行系统研究
SOC系统中高效的卷积解交织实现结构
变换域处理的信道估计算法在OFDM—PON中的应用
基于编码辅助和过采样的成对载波多址信号盲分离算法
无线网络编码随机优先级检测调度算法
基于PSP-LMS的MIMO全双工数字干扰对消
基于白频谱的数字电视上行网络可行性研究
用于电视系统的视频噪声检测的优化算法设计
用于电视系统中的图像清晰度测量算法及实现
Principle and applications of semiconductor optical amplifiers-based turbo-switches
Efficient Scheduling with Random Network Coding in Multi-Relay Wireless Network
期刊信息
  • 《电视技术》
  • 北大核心期刊（2011版）
  • 主管单位:中国电子科技集团公司
  • 主办单位:电视电声研究所
  • 主编：许盈（执行主编）
  • 地址：北京市朝阳区酒仙桥北路乙7号
  • 邮编：100015
  • 邮箱：tvea@263.net.cn; dsss@chinajournal.net.cn
  • 电话：010-59570246
  • 国际标准刊号：ISSN：1002-8692
  • 国内统一刊号：ISSN：11-2123/TN
  • 邮发代号:2-354
  • 获奖情况:
  • 第三届国家期刊奖百种重点期刊、中国期刊方阵双百...
  • 国内外数据库收录:
  • 美国剑桥科学文摘,英国科学文摘数据库,中国北大核心期刊（2004版）,中国北大核心期刊（2008版）,中国北大核心期刊（2011版）,中国北大核心期刊（2014版）,中国北大核心期刊（2000版）
  • 被引量:12712