Chromium Code Reviews
chromiumcodereview-hr@appspot.gserviceaccount.com (chromiumcodereview-hr) | Please choose your nickname with Settings | Help | Chromium Project | Gerrit Changes | Sign out
(353)

Unified Diff: third_party/gsutil/third_party/apitools/apitools/base/py/buffered_stream.py

Issue 1377933002: [catapult] - Copy Telemetry's gsutilz over to third_party. (Closed) Base URL: https://github.com/catapult-project/catapult.git@master
Patch Set: Rename to gsutil. Created 5 years, 3 months ago
Use n/p to move between diff chunks; N/P to move between comments. Draft comments are only viewable by you.
Jump to:
View side-by-side diff with in-line comments
Download patch
Index: third_party/gsutil/third_party/apitools/apitools/base/py/buffered_stream.py
diff --git a/third_party/gsutil/third_party/apitools/apitools/base/py/buffered_stream.py b/third_party/gsutil/third_party/apitools/apitools/base/py/buffered_stream.py
new file mode 100755
index 0000000000000000000000000000000000000000..bda7e65c1fbaca7a142c84803fce6e9eb0a2d091
--- /dev/null
+++ b/third_party/gsutil/third_party/apitools/apitools/base/py/buffered_stream.py
@@ -0,0 +1,59 @@
+#!/usr/bin/env python
+"""Small helper class to provide a small slice of a stream.
+
+This class reads ahead to detect if we are at the end of the stream.
+"""
+
+from apitools.base.py import exceptions
+
+
+# TODO(user): Consider replacing this with a StringIO.
+class BufferedStream(object):
+
+ """Buffers a stream, reading ahead to determine if we're at the end."""
+
+ def __init__(self, stream, start, size):
+ self.__stream = stream
+ self.__start_pos = start
+ self.__buffer_pos = 0
+ self.__buffered_data = self.__stream.read(size)
+ self.__stream_at_end = len(self.__buffered_data) < size
+ self.__end_pos = self.__start_pos + len(self.__buffered_data)
+
+ def __str__(self):
+ return ('Buffered stream %s from position %s-%s with %s '
+ 'bytes remaining' % (self.__stream, self.__start_pos,
+ self.__end_pos, self._bytes_remaining))
+
+ def __len__(self):
+ return len(self.__buffered_data)
+
+ @property
+ def stream_exhausted(self):
+ return self.__stream_at_end
+
+ @property
+ def stream_end_position(self):
+ return self.__end_pos
+
+ @property
+ def _bytes_remaining(self):
+ return len(self.__buffered_data) - self.__buffer_pos
+
+ def read(self, size=None): # pylint: disable=invalid-name
+ """Reads from the buffer."""
+ if size is None or size < 0:
+ raise exceptions.NotYetImplementedError(
+ 'Illegal read of size %s requested on BufferedStream. '
+ 'Wrapped stream %s is at position %s-%s, '
+ '%s bytes remaining.' %
+ (size, self.__stream, self.__start_pos, self.__end_pos,
+ self._bytes_remaining))
+
+ data = ''
+ if self._bytes_remaining:
+ size = min(size, self._bytes_remaining)
+ data = self.__buffered_data[
+ self.__buffer_pos:self.__buffer_pos + size]
+ self.__buffer_pos += size
+ return data

Powered by Google App Engine
This is Rietveld 408576698